ON THE CONVERGENCE OF THE PROXIMAL GRADIENT METHOD WITH VARIABLE STEP SIZES
Математички билтен/BULLETIN MATHÉMATIQUE DE LA SOCIÉTÉ DES MATHÉMATICIENS DE LA RÉPUBLIQUE MACÉDOINE · 01.01.2025 · 49 (1) · 1
DOI: 10.37560/matbil2549101n ↗Kurz gefasst
Fachartikel in der Zeitschrift Математички билтен/BULLETIN MATHÉMATIQUE DE LA SOCIÉTÉ DES MATHÉMATICIENS DE LA RÉPUBLIQUE MACÉDOINE, online erschienen am 01.01.2025. Verfasst von FILIP NIKOLOVSKI und 1 weiteren Autor:innen. Die Arbeit nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Composite optimization problems arise frequently in modeling, since the objective function might contain components that do not possess some "nice" properties like differentiability; the case of $\ell_1$ (LASSO) regularization is one such example. The proximal gradient methods are designed to handle this kind of optimization problems, and can solve them efficiently when the proximal mapping has a closed-form solution. Theoretical analyses of the convergence properties of the proximal gradient method with constant step size have showed sublinear and linear convergence for convex and strongly convex objective functions respectively. In this paper we show that under standard assumptions the same kind of convergence result can be established for the proximal gradient method with variable step sizes in the general setting of bounded step sizes. Further, a recently proposed step size selection for the proximal gradient method with variable step sizes is considered, and the above convergence analysis is implemented for this method.
Zitieren
APA
NIKOLOVSKI, F., & STOJKOVSKA, I. (2025). ON THE CONVERGENCE OF THE PROXIMAL GRADIENT METHOD WITH VARIABLE STEP SIZES. Математички билтен/BULLETIN MATHÉMATIQUE DE LA SOCIÉTÉ DES MATHÉMATICIENS DE LA RÉPUBLIQUE MACÉDOINE, 49(1), 1. https://doi.org/10.37560/matbil2549101n
Vancouver
NIKOLOVSKI F, STOJKOVSKA I. ON THE CONVERGENCE OF THE PROXIMAL GRADIENT METHOD WITH VARIABLE STEP SIZES. Математички билтен/BULLETIN MATHÉMATIQUE DE LA SOCIÉTÉ DES MATHÉMATICIENS DE LA RÉPUBLIQUE MACÉDOINE. 2025;49(1):1. doi:10.37560/matbil2549101n
BibTeX
@article{NIKOLOVSKI2025,
author = {NIKOLOVSKI, FILIP and STOJKOVSKA, IRENA},
title = {ON THE CONVERGENCE OF THE PROXIMAL GRADIENT METHOD WITH VARIABLE STEP SIZES},
journal = {Математички билтен/BULLETIN MATHÉMATIQUE DE LA SOCIÉTÉ DES MATHÉMATICIENS DE LA RÉPUBLIQUE MACÉDOINE},
year = {2025},
volume = {49},
number = {1},
pages = {1},
doi = {10.37560/matbil2549101n}
}
EUVIMED