EUVIMEDEUVIMED entdecken
Crossref

Subgradient Sampling for Nonsmooth Nonconvex Minimization

Jérôme Bolte, Tam Le, Edouard Pauwels

SIAM Journal on Optimization · 31.12.2023 · 33 (4) · 2542-2569

DOI: 10.1137/22m1479178 ↗

Kurz gefasst

Fachartikel in der Zeitschrift SIAM Journal on Optimization, online erschienen am 11.10.2023. Verfasst von Jérôme Bolte und 2 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 57 Literaturangaben. Gefördert von: Agence Nationale de la Recherche, Air Force Office of Scientific Research.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Risk minimization for nonsmooth nonconvex problems naturally leads to first-order sampling or, by an abuse of terminology, to stochastic subgradient descent. We establish the convergence of this method in the path-differentiable case and describe more precise results under additional geometric assumptions. We recover and improve results from Ermoliev and Norkin [ Cybern. Syst. Anal., 34 (1998), pp. 196–215] by using a different approach: conservative calculus and the ODE method. In the definable case, we show that first-order subgradient sampling avoids artificial critical points with probability one and applies moreover to a large range of risk minimization problems in deep learning, based on the backpropagation oracle. As byproducts of our approach, we obtain several results on integration of independent interest, such as an interchange result for conservative derivatives and integrals or the definability of set-valued parameterized integrals.

Förderung

  • Agence Nationale de la Recherche
  • Air Force Office of Scientific Research

Zitieren

APA

Bolte, J., Le, T., & Pauwels, E. (2023). Subgradient Sampling for Nonsmooth Nonconvex Minimization. SIAM Journal on Optimization, 33(4), 2542-2569. https://doi.org/10.1137/22m1479178

Vancouver

Bolte J, Le T, Pauwels E. Subgradient Sampling for Nonsmooth Nonconvex Minimization. SIAM Journal on Optimization. 2023;33(4):2542-2569. doi:10.1137/22m1479178

BibTeX
@article{Bolte2023,
  author = {Bolte, Jérôme and Le, Tam and Pauwels, Edouard},
  title = {Subgradient Sampling for Nonsmooth Nonconvex Minimization},
  journal = {SIAM Journal on Optimization},
  year = {2023},
  volume = {33},
  number = {4},
  pages = {2542--2569},
  doi = {10.1137/22m1479178}
}
Kostenlos starten →