A Unified Analysis of Descent Sequences in Weakly Convex Optimization, Including Convergence Rates for Bundle Methods
SIAM Journal on Optimization · 31.03.2023 · 33 (1) · 89-115
DOI: 10.1137/21m1465445 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Journal on Optimization, online erschienen am 24.01.2023. Verfasst von Felipe Atenas und 3 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 53 Literaturangaben. Gefördert von: Fundação de Amparo à Pesquisa do Estado de São Paulo, Conselho Nacional de Desenvolvimento Científico e Tecnológico, PRONEX-Optimization.
Abstract (Originalsprache)
We present a framework for analyzing convergence and local rates of convergence of a class of descent algorithms, assuming the objective function is weakly convex. The framework is general, in the sense that it combines the possibility of explicit iterations (based on the gradient or a subgradient at the current iterate), implicit iterations (using a subgradient at the next iteration, like in the proximal schemes), as well as iterations when the associated subgradient is specially constructed and does not correspond either to the current or the next point (this is the case of descent steps in bundle methods). Under the subdifferential-based error bound on the distance to critical points, linear rates of convergence are established. Our analysis applies, among other techniques, to prox-descent for decomposable functions, the proximal-gradient method for a sum of functions, redistributed bundle methods, and a class of algorithms that can be cast in the feasible descent framework for constrained optimization.
Förderung
- Fundação de Amparo à Pesquisa do Estado de São Paulo
- Conselho Nacional de Desenvolvimento Científico e Tecnológico
- PRONEX-Optimization
- Fundação Carlos Chagas Filho de Amparo à Pesquisa do Estado do Rio de Janeiro
Zitieren
APA
Atenas, F., Sagastizábal, C., Silva, P. J. S., & Solodov, M. (2023). A Unified Analysis of Descent Sequences in Weakly Convex Optimization, Including Convergence Rates for Bundle Methods. SIAM Journal on Optimization, 33(1), 89-115. https://doi.org/10.1137/21m1465445
Vancouver
Atenas F, Sagastizábal C, Silva PJS, Solodov M. A Unified Analysis of Descent Sequences in Weakly Convex Optimization, Including Convergence Rates for Bundle Methods. SIAM Journal on Optimization. 2023;33(1):89-115. doi:10.1137/21m1465445
BibTeX
@article{Atenas2023,
author = {Atenas, Felipe and Sagastizábal, Claudia and Silva, Paulo J. S. and Solodov, Mikhail},
title = {A Unified Analysis of Descent Sequences in Weakly Convex Optimization, Including Convergence Rates for Bundle Methods},
journal = {SIAM Journal on Optimization},
year = {2023},
volume = {33},
number = {1},
pages = {89--115},
doi = {10.1137/21m1465445}
}
EUVIMED