RELL-STC: An Efficient SpMM Extension of Sparse Tensor Core with Re-structured ELLPACK and Gustavson Dataflow
ACM SIGMETRICS Performance Evaluation Review · 20.07.2026 · 54 (1) · 129-131
DOI: 10.1145/3820171.3806877 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM SIGMETRICS Performance Evaluation Review, online erschienen am 27.07.2026. Verfasst von Jianfeng Cui und 4 weiteren Autor:innen. Die Arbeit nennt 8 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Sparsity is crucial for deep neural networks, reducing storage and bandwidth while improving computational efficiency. With the rapid development of deep neural networks, sparse computation accelerators have become a key research focus. NVIDIA introduced 2:4 fine-grained structured sparsity in the Ampere architecture, doubling Tensor Core peak throughput by retaining two out of four elements, but this may compromise model accuracy. In contrast, unstructured sparsity achieves maximum sparsity without accuracy loss. However, the irregular distribution of non-zero elements (NNZs) in unstructured sparse matrices causes complex memory access and load imbalance, preventing direct use of GPU Tensor Cores. Thus, computation relies on CUDA cores via sparse libraries like cuSPARSE, underutilizing Tensor Cores' capabilities. To address this, we extend the Tensor Core architecture based on Gustavson's dataflow and propose a re-structured row offline compression format for inference. This format integrates with the extended architecture to enable efficient unstructured sparse-dense matrix multiplication. Experiments show negligible area and power overheads, with an average speedup of 3.54x over cuSPARSE and 1.2x over state-of-the-art Tensor Core extensions.
Zitieren
APA
Cui, J., Yuan, B., Jiang, Z., Lu, K., & Liu, S. (2026). RELL-STC: An Efficient SpMM Extension of Sparse Tensor Core with Re-structured ELLPACK and Gustavson Dataflow. ACM SIGMETRICS Performance Evaluation Review, 54(1), 129-131. https://doi.org/10.1145/3820171.3806877
Vancouver
Cui J, Yuan B, Jiang Z, Lu K, Liu S. RELL-STC: An Efficient SpMM Extension of Sparse Tensor Core with Re-structured ELLPACK and Gustavson Dataflow. ACM SIGMETRICS Performance Evaluation Review. 2026;54(1):129-131. doi:10.1145/3820171.3806877
BibTeX
@article{Cui2026,
author = {Cui, Jianfeng and Yuan, Bo and Jiang, Zekun and Lu, Kai and Liu, Sheng},
title = {RELL-STC: An Efficient SpMM Extension of Sparse Tensor Core with Re-structured ELLPACK and Gustavson Dataflow},
journal = {ACM SIGMETRICS Performance Evaluation Review},
year = {2026},
volume = {54},
number = {1},
pages = {129--131},
doi = {10.1145/3820171.3806877}
}
EUVIMED