EUVIMEDEUVIMED entdecken
Crossref

The Augmented Lagrangian Methods: Overview and Recent Advances

Kangkang Deng, Rui Wang, Zhenyuan Zhu, Junyu Zhang, Zaiwen Wen

SIAM Review · 30.09.2026 · 68 (3) · 471-576

DOI: 10.1137/24m1706153 ↗

Kurz gefasst

Fachartikel in der Zeitschrift SIAM Review, online erschienen am 06.08.2026. Verfasst von Kangkang Deng und 4 weiteren Autor:innen. Die Arbeit nennt 248 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Singapore Ministry of Education Academic Research Fund, National Key Research and Development Program of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large-scale constrained optimization is pivotal in modern scientific, engineering, and industrial computation, often involving complex systems with numerous variables and constraints. This paper provides a unified and comprehensive perspective on constructing augmented Lagrangian functions (based on the Hestenes–Powell–Rockafellar augmented Lagrangian) for various optimization problems, including nonlinear programming and convex and nonconvex composite programming. We present the augmented Lagrangian method (ALM), covering its theoretical foundations in both convex and nonconvex cases, and discuss several successful examples and applications. Recent advancements have extended the ALM’s capabilities to handle nonconvex constraints and ensure global convergence to first- and second-order stationary points. For nonsmooth convex problems, the ALM utilizes proximal operations, preserving desirable properties such as locally linear convergence rates. Furthermore, recent progress has refined the complexity analysis of the ALM and tackled challenging integer programming instances. This review aims to offer a thorough understanding of the ALM’s benefits and limitations, exploring different ALM variants designed to enhance convergence and computational performance. We also illustrate effective algorithms for ALM subproblems across different types of optimization problems and highlight practical implementations in several fields.

Förderung

  • National Natural Science Foundation of China
  • Singapore Ministry of Education Academic Research Fund
  • National Key Research and Development Program of China

Zitieren

APA

Deng, K., Wang, R., Zhu, Z., Zhang, J., & Wen, Z. (2026). The Augmented Lagrangian Methods: Overview and Recent Advances. SIAM Review, 68(3), 471-576. https://doi.org/10.1137/24m1706153

Vancouver

Deng K, Wang R, Zhu Z, Zhang J, Wen Z. The Augmented Lagrangian Methods: Overview and Recent Advances. SIAM Review. 2026;68(3):471-576. doi:10.1137/24m1706153

BibTeX
@article{Deng2026,
  author = {Deng, Kangkang and Wang, Rui and Zhu, Zhenyuan and Zhang, Junyu and Wen, Zaiwen},
  title = {The Augmented Lagrangian Methods: Overview and Recent Advances},
  journal = {SIAM Review},
  year = {2026},
  volume = {68},
  number = {3},
  pages = {471--576},
  doi = {10.1137/24m1706153}
}
Kostenlos starten →