EUVIMEDEUVIMED entdecken
Crossref

Parameter-Free FISTA by Adaptive Restart and Backtracking

Jean-François Aujol, Luca Calatroni, Charles Dossal, Hippolyte Labarrière, Aude Rondepierre

SIAM Journal on Optimization · 31.12.2024 · 34 (4) · 3259-3285

DOI: 10.1137/23m158961x ↗

Kurz gefasst

Fachartikel in der Zeitschrift SIAM Journal on Optimization, online erschienen am 01.10.2024. Verfasst von Jean-François Aujol und 4 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 42 Literaturangaben. Gefördert von: PEPR, EDF-Thales-Orange, ANR MICROBLIND.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We consider a combined restarting and adaptive backtracking strategy for the popular fast iterative shrinking-thresholding algorithm (FISTA) frequently employed for accelerating the convergence speed of large-scale structured convex optimization problems. Several variants of FISTA enjoy a provable linear convergence rate for the function values [Formula: see text] of the form [Formula: see text] under the prior knowledge of problem conditioning, i.e., of the ratio between the (Łojasiewicz) parameter [Formula: see text] determining the growth of the objective function and the Lipschitz constant [Formula: see text] of its smooth component. These parameters are nonetheless hard to estimate in many practical cases. Recent works address the problem by estimating either parameter via suitable adaptive strategies. In our work both parameters can be estimated at the same time by means of an algorithmic restarting scheme where, at each restart, a nonmonotone estimation of [Formula: see text] is performed. For this scheme, theoretical convergence results are proved, showing that an [Formula: see text] convergence speed can still be achieved along with quantitative estimates of the conditioning. The resulting free-FISTA is therefore parameter-free. Several numerical results are reported to confirm the practical interest of its use in many example problems.

Förderung

  • PEPR
  • EDF-Thales-Orange
  • ANR MICROBLIND
  • ANR Masdol
  • Agence Nationale de la Recherche
  • H2020 Marie Skłodowska-Curie Actions
  • Fondation Mathématique Jacques Hadamard
  • Ministry of Education, University and Research

Zitieren

APA

Aujol, J., Calatroni, L., Dossal, C., Labarrière, H., & Rondepierre, A. (2024). Parameter-Free FISTA by Adaptive Restart and Backtracking. SIAM Journal on Optimization, 34(4), 3259-3285. https://doi.org/10.1137/23m158961x

Vancouver

Aujol J, Calatroni L, Dossal C, Labarrière H, Rondepierre A. Parameter-Free FISTA by Adaptive Restart and Backtracking. SIAM Journal on Optimization. 2024;34(4):3259-3285. doi:10.1137/23m158961x

BibTeX
@article{Aujol2024,
  author = {Aujol, Jean-François and Calatroni, Luca and Dossal, Charles and Labarrière, Hippolyte and Rondepierre, Aude},
  title = {Parameter-Free FISTA by Adaptive Restart and Backtracking},
  journal = {SIAM Journal on Optimization},
  year = {2024},
  volume = {34},
  number = {4},
  pages = {3259--3285},
  doi = {10.1137/23m158961x}
}
Kostenlos starten →