Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants
SIAM Review · 2024-05 · 66 (2) · 319-352
DOI: 10.1137/24m1628578 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Review, online erschienen am 09.05.2024. Verfasst von Shixiang Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 119 Literaturangaben. Gefördert von: National Science Foundation, Research Grants Council, University Grants Committee, Rice University.
Abstract (Originalsprache)
We consider optimization problems over the Stiefel manifold whose objective function is the summation of a smooth function and a nonsmooth function. Existing methods for solving this class of problems converge slowly in practice, involve subproblems that can be as difficult as the original problem, or lack rigorous convergence guarantees. In this paper, we propose a manifold proximal gradient method (ManPG) for solving this class of problems. We prove that the proposed method converges globally to a stationary point and establish its iteration complexity for obtaining an $\epsilon$-stationary point. Furthermore, we present numerical results on the sparse PCA and compressed modes problems to demonstrate the advantages of the proposed method. We also discuss some recent advances related to ManPG for Riemannian optimization with nonsmooth objective functions.
Förderung
- National Science Foundation
- Research Grants Council, University Grants Committee
- Rice University
- University of Science and Technology of China
Zitieren
APA
Chen, S., Ma, S., So, A. M., & Zhang, T. (2024). Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants. SIAM Review, 66(2), 319-352. https://doi.org/10.1137/24m1628578
Vancouver
Chen S, Ma S, So AM, Zhang T. Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants. SIAM Review. 2024;66(2):319-352. doi:10.1137/24m1628578
BibTeX
@article{Chen2024,
author = {Chen, Shixiang and Ma, Shiqian and So, Anthony Man-Cho and Zhang, Tong},
title = {Nonsmooth Optimization over the Stiefel Manifold and Beyond: Proximal Gradient Method and Recent Variants},
journal = {SIAM Review},
year = {2024},
volume = {66},
number = {2},
pages = {319--352},
doi = {10.1137/24m1628578}
}
EUVIMED