Towards understanding CG and GMRES through examples
Linear Algebra and its Applications · 2024-07 · 692 · 241-291
DOI: 10.1016/j.laa.2024.04.003 ↗Kurz gefasst
Fachartikel in der Zeitschrift Linear Algebra and its Applications, 2024-07. Verfasst von Erin Carson und 2 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 114 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: European Research Council.
Abstract (Originalsprache)
When the CG method for solving linear algebraic systems was formulated about 70 years ago by Lanczos, Hestenes, and Stiefel, it was considered an iterative process possessing a mathematical finite termination property. CG was placed into a rich mathematical context, including links with Gauss quadrature and continued fractions. The optimality property of CG was described via a normalized weighted polynomial least squares approximation to zero. This highly nonlinear problem explains the adaptation of CG iterates to the given data. Karush and Hayes immediately considered CG in infinite dimensional Hilbert spaces and investigated its superlinear convergence. Since then, the view of CG and other Krylov subspace methods has changed. Today these methods are primarily used as computational tools, and their behavior is typically characterized using linear upper bounds or heuristics based on clustering of eigenvalues. Such simplifications limit the mathematical understanding and also negatively affect their practical application. This paper offers a different perspective. Focusing on CG and GMRES, it presents mathematically important and practically relevant phenomena that uncover their behavior through a discussion of computed examples. These examples provide an easily accessible approach that enables understanding of the methods, while pointers to more detailed analyses in the literature are given. This approach allows readers to choose the level of depth and thoroughness appropriate for their intentions. Some of the points made in this paper illustrate well known facts. Others challenge mainstream views and explain existing misunderstandings. Several points refer to recent results leading to open problems. We consider CG and GMRES crucially important for the mathematical understanding, further development, and practical applications also of other Krylov subspace methods.
Förderung
- European Research Council
Zitieren
APA
Carson, E., Liesen, J., & Strakoš, Z. (2024). Towards understanding CG and GMRES through examples. Linear Algebra and its Applications, 692, 241-291. https://doi.org/10.1016/j.laa.2024.04.003
Vancouver
Carson E, Liesen J, Strakoš Z. Towards understanding CG and GMRES through examples. Linear Algebra and its Applications. 2024;692:241-291. doi:10.1016/j.laa.2024.04.003
BibTeX
@article{Carson2024,
author = {Carson, Erin and Liesen, Jörg and Strakoš, Zdeněk},
title = {Towards understanding CG and GMRES through examples},
journal = {Linear Algebra and its Applications},
year = {2024},
volume = {692},
pages = {241--291},
doi = {10.1016/j.laa.2024.04.003}
}
EUVIMED