EUVIMEDEUVIMED entdecken
Crossref

Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning

Sean Lie

IEEE Micro · 2023-05 · 43 (3) · 18-30

DOI: 10.1109/mm.2023.3256384 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Micro, 2023-05. Verfasst von Sean Lie. Die Arbeit wurde bisher 72-mal zitiert (Crossref) und nennt 13 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The compute and memory demands for deep learning and machine learning (ML) have increased by several orders of magnitude in just the last couple of years, and there is no end in sight. Traditional improvements in processor performance alone struggle to keep up with the exponential demand. A new chip architecture co-designed with the ML algorithms can be better equipped to satisfy this unprecedented demand and enable the ML workloads of the future. This article describes the Cerebras architecture and how it is designed specifically with this purpose, from the ground up, as a wafer-sized chip to enable emerging extreme-scale ML models. It uses fine-grained data flow compute cores to accelerate unstructured sparsity, distributed static random-access memory for full memory bandwidth to the data paths, and a specially designed on-chip and off-chip interconnect for ML training. With these techniques, the Cerebras architecture provides unique capabilities beyond traditional designs.

Zitieren

APA

Lie, S. (2023). Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning. IEEE Micro, 43(3), 18-30. https://doi.org/10.1109/mm.2023.3256384

Vancouver

Lie S. Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning. IEEE Micro. 2023;43(3):18-30. doi:10.1109/mm.2023.3256384

BibTeX
@article{Lie2023,
  author = {Lie, Sean},
  title = {Cerebras Architecture Deep Dive: First Look Inside the Hardware/Software Co-Design for Deep Learning},
  journal = {IEEE Micro},
  year = {2023},
  volume = {43},
  number = {3},
  pages = {18--30},
  doi = {10.1109/mm.2023.3256384}
}
Kostenlos starten →