EUVIMEDEUVIMED entdecken
Crossref

GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication

Xiaoyu Zhang, Zerun Li, Rui Liu, Xiaoming Chen, Yinhe Han

IEEE Transactions on Computers · 2024-06 · 73 (6) · 1427-1441

DOI: 10.1109/tc.2024.3371790 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Computers, 2024-06. Verfasst von Xiaoyu Zhang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Key Research Program of Frontier Sciences, Chinese Academy of Sciences.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Sparse matrix multiplication is widely used in various practical applications. Different accelerators have been proposed to speed up sparse matrix-dense vector multiplication (SpMV), sparse matrix-sparse vector multiplication (SpMSpV), sparse matrix-dense matrix multiplication (SpMM), and sparse matrix-sparse matrix multiplication (SpMSpM). The performance of traditional sparse matrix multiplication accelerators is typically bounded by memory access due to the poor data locality and irregular memory access. In-memory computing (IMC) is a promising technique to alleviate the memory bottleneck. Previous IMC studies are mostly focused on accelerating a single sparse matrix multiplication function. In this paper, we propose GAS, a general-purpose IMC accelerator for sparse matrix multiplication. GAS integrates non-volatile memory based content-addressable memory (CAM) arrays and multiply-add computation (MAC) arrays to support sparse matrices represented in the double-precision floating-point format. Using a unified outer product based multiplication methodology, GAS supports the acceleration of SpMV, SpMSpv, SpMM, and SpMSpM. We further propose four optimization techniques to speed up the computation of GAS. GAS achieves significant speedups and energy savings over central processing unit (CPU) and graphics processing unit (GPU) implementations. Compared with state-of-the-art traditional and IMC-based accelerators, GAS not only supports more functions, but also achieves higher performance and energy efficiency.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Key Research Program of Frontier Sciences, Chinese Academy of Sciences
  • Strategic Priority Research Program of CAS
  • Innovative Project of Institute of Computing Technology, CAS

Zitieren

APA

Zhang, X., Li, Z., Liu, R., Chen, X., & Han, Y. (2024). GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication. IEEE Transactions on Computers, 73(6), 1427-1441. https://doi.org/10.1109/tc.2024.3371790

Vancouver

Zhang X, Li Z, Liu R, Chen X, Han Y. GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication. IEEE Transactions on Computers. 2024;73(6):1427-1441. doi:10.1109/tc.2024.3371790

BibTeX
@article{Zhang2024,
  author = {Zhang, Xiaoyu and Li, Zerun and Liu, Rui and Chen, Xiaoming and Han, Yinhe},
  title = {GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication},
  journal = {IEEE Transactions on Computers},
  year = {2024},
  volume = {73},
  number = {6},
  pages = {1427--1441},
  doi = {10.1109/tc.2024.3371790}
}
Kostenlos starten →