How to grade the accuracy of the BLAS
ACM Transactions on Mathematical Software · 12.11.2026
DOI: 10.1145/3862636 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Mathematical Software, online erschienen am 12.11.2026. Verfasst von James Demmel und 6 weiteren Autor:innen. Die Arbeit nennt 48 Literaturangaben.
Abstract (Originalsprache)
Motivated by accelerating machine learning (ML), many computer vendors are building accelerators for matrix multiplication, which save time and energy by operating in lower precisions needed for ML. This has in turn motivated many efforts to use these accelerators to provide faster matrix multiplication implementations with the higher precision required by many other linear algebra applications. Motivated by the large design space of algorithms for approximating higher precision, with significant performance/accuracy tradeoffs, we provide a metric to “grade the accuracy” of a matrix multiplication implementation (or the BLAS more generally), ranging from an “A” for attaining the classic floating point error bound, to a “C” for attaining a weaker but still useful bound, that is satisfied by Strassen-like algorithms. We also propose “ungameable” tests that vendors or users can run to verify their promised accuracy, and describe how these different grades impact the accuracy of applications like Cholesky decomposition. Our test code is publicly available, and we plan to publicly release all our test results. Future work includes expanding our testing and grading to other BLAS routines, nonsquare matrices, use of higher internal precision, complex arithmetic, consistent exception handling, underflow handling, and other high level routines like LU and QR.
Zitieren
APA
Demmel, J., Henry, G., Kozachenko, I., Langou, J., Li, X. S., Riedy, J., & Vanover, J. (2026). How to grade the accuracy of the BLAS. ACM Transactions on Mathematical Software. https://doi.org/10.1145/3862636
Vancouver
Demmel J, Henry G, Kozachenko I, Langou J, Li XS, Riedy J, et al. How to grade the accuracy of the BLAS. ACM Transactions on Mathematical Software. 2026. doi:10.1145/3862636
BibTeX
@article{Demmel2026,
author = {Demmel, James and Henry, Greg and Kozachenko, Igor and Langou, Julien and Li, Xiaoye Sherry and Riedy, Jason and Vanover, Jackson},
title = {How to grade the accuracy of the BLAS},
journal = {ACM Transactions on Mathematical Software},
year = {2026},
doi = {10.1145/3862636}
}
EUVIMED