How to Keep Pushing ML Accelerator Performance? Know Your Rooflines!
IEEE Journal of Solid-State Circuits · 2025-06 · 60 (6) · 1888-1905
DOI: 10.1109/jssc.2025.3553765 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Journal of Solid-State Circuits, 2025-06. Verfasst von Marian Verhelst und 2 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 80 Literaturangaben.
Abstract (Originalsprache)
The rapidly growing importance of machine learning (ML) applications, coupled with their ever-increasing model size and inference energy footprint, has created a strong need for specialized ML hardware architectures. Numerous ML accelerators have been explored and implemented, primarily to increase task-level throughput per unit area and reduce task-level energy consumption. This article surveys key trends toward these objectives for more efficient ML accelerators and provides a unifying framework to understand how compute and memory technologies/architectures interact to enhance system-level efficiency and performance. To achieve this, this article introduces an enhanced version of the roofline model and applies it to ML accelerators as an effective tool for understanding where various execution regimes fall within roofline bounds and how to maximize performance and efficiency under the roofline. Key concepts are illustrated with examples from state-of-the-art (SOTA) designs, with a view toward open research opportunities to further advance accelerator performance.
Zitieren
APA
Verhelst, M., Benini, L., & Verma, N. (2025). How to Keep Pushing ML Accelerator Performance? Know Your Rooflines!. IEEE Journal of Solid-State Circuits, 60(6), 1888-1905. https://doi.org/10.1109/jssc.2025.3553765
Vancouver
Verhelst M, Benini L, Verma N. How to Keep Pushing ML Accelerator Performance? Know Your Rooflines!. IEEE Journal of Solid-State Circuits. 2025;60(6):1888-1905. doi:10.1109/jssc.2025.3553765
BibTeX
@article{Verhelst2025,
author = {Verhelst, Marian and Benini, Luca and Verma, Naveen},
title = {How to Keep Pushing ML Accelerator Performance? Know Your Rooflines!},
journal = {IEEE Journal of Solid-State Circuits},
year = {2025},
volume = {60},
number = {6},
pages = {1888--1905},
doi = {10.1109/jssc.2025.3553765}
}
EUVIMED