Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning
IEEE Micro · 2023-05 · 43 (3) · 18-30
DOI: 10.1109/mm.2023.3256384 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Micro, 2023-05. Verfasst von Sean Lie. Die Arbeit wurde bisher 72-mal zitiert (Crossref) und nennt 13 Literaturangaben.
Abstract (Originalsprache)
The compute and memory demands for deep learning and machine learning (ML) have increased by several orders of magnitude in just the last couple of years, and there is no end in sight. Traditional improvements in processor performance alone struggle to keep up with the exponential demand. A new chip architecture co-designed with the ML algorithms can be better equipped to satisfy this unprecedented demand and enable the ML workloads of the future. This article describes the Cerebras architecture and how it is designed specifically with this purpose, from the ground up, as a wafer-sized chip to enable emerging extreme-scale ML models. It uses fine-grained data flow compute cores to accelerate unstructured sparsity, distributed static random-access memory for full memory bandwidth to the data paths, and a specially designed on-chip and off-chip interconnect for ML training. With these techniques, the Cerebras architecture provides unique capabilities beyond traditional designs.
Zitieren
APA
Lie, S. (2023). Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning. IEEE Micro, 43(3), 18-30. https://doi.org/10.1109/mm.2023.3256384
Vancouver
Lie S. Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning. IEEE Micro. 2023;43(3):18-30. doi:10.1109/mm.2023.3256384
BibTeX
@article{Lie2023,
author = {Lie, Sean},
title = {Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning},
journal = {IEEE Micro},
year = {2023},
volume = {43},
number = {3},
pages = {18--30},
doi = {10.1109/mm.2023.3256384}
}
EUVIMED