EUVIMEDEUVIMED entdecken
Crossref

Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants

Shixiang Chen, Shiqian Ma, Anthony Man-Cho So, Tong Zhang

SIAM Review · 2024-05 · 66 (2) · 319-352

DOI: 10.1137/24m1628578 ↗

Kurz gefasst

Fachartikel in der Zeitschrift SIAM Review, online erschienen am 09.05.2024. Verfasst von Shixiang Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 119 Literaturangaben. Gefördert von: National Science Foundation, Research Grants Council, University Grants Committee, Rice University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We consider optimization problems over the Stiefel manifold whose objective function is the summation of a smooth function and a nonsmooth function. Existing methods for solving this class of problems converge slowly in practice, involve subproblems that can be as difficult as the original problem, or lack rigorous convergence guarantees. In this paper, we propose a manifold proximal gradient method (ManPG) for solving this class of problems. We prove that the proposed method converges globally to a stationary point and establish its iteration complexity for obtaining an $\epsilon$-stationary point. Furthermore, we present numerical results on the sparse PCA and compressed modes problems to demonstrate the advantages of the proposed method. We also discuss some recent advances related to ManPG for Riemannian optimization with nonsmooth objective functions.

Förderung

  • National Science Foundation
  • Research Grants Council, University Grants Committee
  • Rice University
  • University of Science and Technology of China

Zitieren

APA

Chen, S., Ma, S., So, A. M., & Zhang, T. (2024). Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants. SIAM Review, 66(2), 319-352. https://doi.org/10.1137/24m1628578

Vancouver

Chen S, Ma S, So AM, Zhang T. Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants. SIAM Review. 2024;66(2):319-352. doi:10.1137/24m1628578

BibTeX
@article{Chen2024,
  author = {Chen, Shixiang and Ma, Shiqian and So, Anthony Man-Cho and Zhang, Tong},
  title = {Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants},
  journal = {SIAM Review},
  year = {2024},
  volume = {66},
  number = {2},
  pages = {319--352},
  doi = {10.1137/24m1628578}
}
Kostenlos starten →