Level constrained first order methods for function constrained optimization
Mathematical Programming · 2025-01 · 209 (1-2) · 1-61
DOI: 10.1007/s10107-024-02057-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematical Programming, online erschienen am 06.03.2024. Verfasst von Digvijay Boob und 2 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Institute of Food and Agriculture, Division of Mathematical Sciences, National Natural Science Foundation of China-China Academy of General Technology Joint Fund for Basic Research.
Abstract (Originalsprache)
We present a new feasible proximal gradient method for constrained optimization where both the objective and constraint functions are given by summation of a smooth, possibly nonconvex function and a convex simple function. The algorithm converts the original problem into a sequence of convex subproblems. Formulating those subproblems requires the evaluation of at most one gradient-value of the original objective and constraint functions. Either exact or approximate subproblems solutions can be computed efficiently in many cases. An important feature of the algorithm is the constraint level parameter. By carefully increasing this level for each subproblem, we provide a simple solution to overcome the challenge of bounding the Lagrangian multipliers and show that the algorithm follows a strictly feasible solution path till convergence to the stationary point. We develop a simple, proximal gradient descent type analysis, showing that the complexity bound of this new algorithm is comparable to gradient descent for the unconstrained setting which is new in the literature. Exploiting this new design and analysis technique, we extend our algorithms to some more challenging constrained optimization problems where (1) the objective is a stochastic or finite-sum function, and (2) structured nonsmooth functions replace smooth components of both objective and constraint functions. Complexity results for these problems also seem to be new in the literature. Finally, our method can also be applied to convex function constrained problems where we show complexities similar to the proximal gradient method.
Förderung
- National Institute of Food and Agriculture
- Division of Mathematical Sciences
- National Natural Science Foundation of China-China Academy of General Technology Joint Fund for Basic Research
- Division of Computing and Communication Foundations
Zitieren
APA
Boob, D., Deng, Q., & Lan, G. (2025). Level constrained first order methods for function constrained optimization. Mathematical Programming, 209(1-2), 1-61. https://doi.org/10.1007/s10107-024-02057-4
Vancouver
Boob D, Deng Q, Lan G. Level constrained first order methods for function constrained optimization. Mathematical Programming. 2025;209(1-2):1-61. doi:10.1007/s10107-024-02057-4
BibTeX
@article{Boob2025,
author = {Boob, Digvijay and Deng, Qi and Lan, Guanghui},
title = {Level constrained first order methods for function constrained optimization},
journal = {Mathematical Programming},
year = {2025},
volume = {209},
number = {1-2},
pages = {1--61},
doi = {10.1007/s10107-024-02057-4}
}
EUVIMED