On the Convergence Rates of Iterative Regularization Algorithms for Composite Bilevel Optimization
SIAM Journal on Optimization · 30.06.2026 · 36 (2) · 1043-1074
DOI: 10.1137/24m1703355 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Journal on Optimization, online erschienen am 19.06.2026. Verfasst von Shimrit Shtern und 1 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Gefördert von: Israel Science Foundation.
Abstract (Originalsprache)
This paper investigates iterative methods for solving bilevel optimization problems where both inner and outer functions have a composite structure. We establish novel theoretical results, including the first analysis that provides simultaneous convergence rates for the iteratively regularized proximal gradient (IRE-PG) method, a variant of Solodov’s algorithm. These rates for the inner and outer functions highlight the inherent trade-offs between their respective convergence behaviors. We further extend this analysis to an accelerated version of IRE-PG, proving faster convergence rates under specific settings. Additionally, we propose a new scheme for handling cases where these methods cannot be directly applied to the bilevel problem due to the difficulty of computing the associated proximal operator. This scheme offers surrogate functions to approximate the original problem and a framework to translate convergence rates between the surrogate and original functions. Our results show that the accelerated method’s advantage diminishes under this translation.
Förderung
- Israel Science Foundation
Zitieren
APA
Shtern, S., & Taiwo, A. (2026). On the Convergence Rates of Iterative Regularization Algorithms for Composite Bilevel Optimization. SIAM Journal on Optimization, 36(2), 1043-1074. https://doi.org/10.1137/24m1703355
Vancouver
Shtern S, Taiwo A. On the Convergence Rates of Iterative Regularization Algorithms for Composite Bilevel Optimization. SIAM Journal on Optimization. 2026;36(2):1043-1074. doi:10.1137/24m1703355
BibTeX
@article{Shtern2026,
author = {Shtern, Shimrit and Taiwo, Adeolu},
title = {On the Convergence Rates of Iterative Regularization Algorithms for Composite Bilevel Optimization},
journal = {SIAM Journal on Optimization},
year = {2026},
volume = {36},
number = {2},
pages = {1043--1074},
doi = {10.1137/24m1703355}
}
EUVIMED