On adapting Nesterov's scheme to accelerate iterative methods for linear problems
Numerical Linear Algebra with Applications · 2022-03 · 29 (2)
DOI: 10.1002/nla.2417 ↗Kurz gefasst
Fachartikel in der Zeitschrift Numerical Linear Algebra with Applications, online erschienen am 17.10.2021. Verfasst von Tao Hong und 1 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 26 Literaturangaben.
Abstract (Originalsprache)
Nesterov's well‐known scheme for accelerating gradient descent in convex optimization problems is adapted to accelerating stationary iterative solvers for linear systems. Compared with classical Krylov subspace acceleration methods, the proposed scheme requires more iterations, but it is trivial to implement and retains essentially the same computational cost as the unaccelerated method. An explicit formula for a fixed optimal parameter is derived in the case where the stationary iteration matrix has only real eigenvalues, based only on the smallest and largest eigenvalues. The fixed parameter and corresponding convergence factor are shown to maintain their optimality when the iteration matrix also has complex eigenvalues that are contained within an explicitly defined disk in the complex plane. A comparison to Chebyshev acceleration based on the same information of the smallest and largest real eigenvalues (dubbed restricted information Chebyshev acceleration) demonstrates that Nesterov's scheme is more robust in the sense that it remains optimal over a larger domain when the iteration matrix does have some complex eigenvalues. Numerical tests validate the efficiency of the proposed scheme. This work generalizes and extends the results of [14, lemmas 3.1 and 3.2 and theorem 3.3].
Zitieren
APA
Hong, T., & Yavneh, I. (2022). On adapting Nesterov's scheme to accelerate iterative methods for linear problems. Numerical Linear Algebra with Applications, 29(2). https://doi.org/10.1002/nla.2417
Vancouver
Hong T, Yavneh I. On adapting Nesterov's scheme to accelerate iterative methods for linear problems. Numerical Linear Algebra with Applications. 2022;29(2). doi:10.1002/nla.2417
BibTeX
@article{Hong2022,
author = {Hong, Tao and Yavneh, Irad},
title = {On adapting Nesterov's scheme to accelerate iterative methods for linear problems},
journal = {Numerical Linear Algebra with Applications},
year = {2022},
volume = {29},
number = {2},
doi = {10.1002/nla.2417}
}
EUVIMED