Alternating Gradient-Type Algorithm for Bilevel Optimization with Inexact Lower-Level Solutions via Moreau Envelope–Based Reformulation
SIAM Journal on Optimization · 31.03.2026 · 36 (1) · 350-380
DOI: 10.1137/24m1721049 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Journal on Optimization, online erschienen am 06.03.2026. Verfasst von Xiaoning Bai und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 63 Literaturangaben. Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, Shenzhen Fundamental Research Program.
Abstract (Originalsprache)
In this paper, we study a class of bilevel optimization problems where the lower-level problem is a convex composite optimization model, which arises in various applications, including bilevel hyperparameter selection for regularized regression models. To solve these problems, we propose an alternating gradient–type algorithm with inexact lower-level solutions (AGILS) based on a Moreau envelope–based reformulation of the bilevel optimization problem. The proposed algorithm does not require exact solutions of the lower-level problem at each iteration, improving computational efficiency. We prove the convergence of AGILS to stationary points and, under the Kurdyka–Łojasiewicz property, establish its sequential convergence. Numerical experiments, including a toy example and a bilevel hyperparameter selection problem for the sparse group Lasso model, demonstrate the effectiveness of the proposed AGILS.
Förderung
- National Key R&D Program of China
- National Natural Science Foundation of China
- Shenzhen Fundamental Research Program
Zitieren
APA
Bai, X., Zeng, S., Zhang, J., & Zhang, L. (2026). Alternating Gradient-Type Algorithm for Bilevel Optimization with Inexact Lower-Level Solutions via Moreau Envelope–Based Reformulation. SIAM Journal on Optimization, 36(1), 350-380. https://doi.org/10.1137/24m1721049
Vancouver
Bai X, Zeng S, Zhang J, Zhang L. Alternating Gradient-Type Algorithm for Bilevel Optimization with Inexact Lower-Level Solutions via Moreau Envelope–Based Reformulation. SIAM Journal on Optimization. 2026;36(1):350-380. doi:10.1137/24m1721049
BibTeX
@article{Bai2026,
author = {Bai, Xiaoning and Zeng, Shangzhi and Zhang, Jin and Zhang, Lezhi},
title = {Alternating Gradient-Type Algorithm for Bilevel Optimization with Inexact Lower-Level Solutions via Moreau Envelope–Based Reformulation},
journal = {SIAM Journal on Optimization},
year = {2026},
volume = {36},
number = {1},
pages = {350--380},
doi = {10.1137/24m1721049}
}
EUVIMED