EUVIMEDEUVIMED entdecken
Crossref

Adaptive Bilevel Optimization

Kimon Antonakopoulos, Shoham Sabach, Luca Viano, Mingyi Hong, Volkan Cevher

ACM / IMS Journal of Data Science · 2025

DOI: 10.1145/3728478 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM / IMS Journal of Data Science, 2025. Verfasst von Kimon Antonakopoulos und 4 weiteren Autor:innen. Die Arbeit nennt 70 Literaturangaben. Gefördert von: Hasler Foundation Program: Hasler Responsible AI, Army Research Office, Swiss National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We propose a new adaptive optimization algorithm based on mirror descent for a class of possibly non-convex smooth bilevel optimization problems. The bilevel optimization template is broadly applicable in machine learning as it features two coupled problems where the optimal solution set of an inner problem serves as a constraint set for the outer problem. Currently, available algorithms require knowledge of both inner and outer gradient Lipschitz constants, which are difficult to tune in practice. By using an “on the fly” accumulation strategy on gradient norms, our adaptive algorithm circumvents this difficulty, and to our knowledge, is the first adaptive algorithm for bilevel optimization. In the convex setting, we obtain a convergence rate of \(\mathcal {O}(1/T)\) in terms of the outer objective function, where T is the number of iterations. For non-convex outer objective functions, our algorithm achieves a best-iterate guarantee of \(\mathcal {O}(1/T)\) in terms of the squared norm of the gradient of the outer objective function. Additionally, we provide numerical evidence to support the theory in a reinforcement learning setting.

Förderung

  • Hasler Foundation Program: Hasler Responsible AI
  • Army Research Office
  • Swiss National Science Foundation
  • NSF

Zitieren

APA

Antonakopoulos, K., Sabach, S., Viano, L., Hong, M., & Cevher, V. (2025). Adaptive Bilevel Optimization. ACM / IMS Journal of Data Science. https://doi.org/10.1145/3728478

Vancouver

Antonakopoulos K, Sabach S, Viano L, Hong M, Cevher V. Adaptive Bilevel Optimization. ACM / IMS Journal of Data Science. 2025. doi:10.1145/3728478

BibTeX
@article{Antonakopoulos2025,
  author = {Antonakopoulos, Kimon and Sabach, Shoham and Viano, Luca and Hong, Mingyi and Cevher, Volkan},
  title = {Adaptive Bilevel Optimization},
  journal = {ACM / IMS Journal of Data Science},
  year = {2025},
  doi = {10.1145/3728478}
}
Kostenlos starten →