GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication
IEEE Transactions on Computers · 2024-06 · 73 (6) · 1427-1441
DOI: 10.1109/tc.2024.3371790 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Computers, 2024-06. Verfasst von Xiaoyu Zhang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Key Research Program of Frontier Sciences, Chinese Academy of Sciences.
Abstract (Originalsprache)
Sparse matrix multiplication is widely used in various practical applications. Different accelerators have been proposed to speed up sparse matrix-dense vector multiplication (SpMV), sparse matrix-sparse vector multiplication (SpMSpV), sparse matrix-dense matrix multiplication (SpMM), and sparse matrix-sparse matrix multiplication (SpMSpM). The performance of traditional sparse matrix multiplication accelerators is typically bounded by memory access due to the poor data locality and irregular memory access. In-memory computing (IMC) is a promising technique to alleviate the memory bottleneck. Previous IMC studies are mostly focused on accelerating a single sparse matrix multiplication function. In this paper, we propose GAS, a general-purpose IMC accelerator for sparse matrix multiplication. GAS integrates non-volatile memory based content-addressable memory (CAM) arrays and multiply-add computation (MAC) arrays to support sparse matrices represented in the double-precision floating-point format. Using a unified outer product based multiplication methodology, GAS supports the acceleration of SpMV, SpMSpv, SpMM, and SpMSpM. We further propose four optimization techniques to speed up the computation of GAS. GAS achieves significant speedups and energy savings over central processing unit (CPU) and graphics processing unit (GPU) implementations. Compared with state-of-the-art traditional and IMC-based accelerators, GAS not only supports more functions, but also achieves higher performance and energy efficiency.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Key Research Program of Frontier Sciences, Chinese Academy of Sciences
- Strategic Priority Research Program of CAS
- Innovative Project of Institute of Computing Technology, CAS
Zitieren
APA
Zhang, X., Li, Z., Liu, R., Chen, X., & Han, Y. (2024). GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication. IEEE Transactions on Computers, 73(6), 1427-1441. https://doi.org/10.1109/tc.2024.3371790
Vancouver
Zhang X, Li Z, Liu R, Chen X, Han Y. GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication. IEEE Transactions on Computers. 2024;73(6):1427-1441. doi:10.1109/tc.2024.3371790
BibTeX
@article{Zhang2024,
author = {Zhang, Xiaoyu and Li, Zerun and Liu, Rui and Chen, Xiaoming and Han, Yinhe},
title = {GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication},
journal = {IEEE Transactions on Computers},
year = {2024},
volume = {73},
number = {6},
pages = {1427--1441},
doi = {10.1109/tc.2024.3371790}
}
EUVIMED