Compressed and Parallelized Structured Tensor Algebra
Proceedings of the ACM on Programming Languages · 09.04.2025 · 9 (OOPSLA1) · 1717-1745
DOI: 10.1145/3720506 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Programming Languages, online erschienen am 09.04.2025. Verfasst von Mahdi Ghorbani und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Engineering and Physical Sciences Research Council.
Abstract (Originalsprache)
Tensor algebra is a crucial component for data-intensive workloads such as machine learning and scientific computing. As the complexity of data grows, scientists often encounter a dilemma between the highly specialized dense tensor algebra and efficient structure-aware algorithms provided by sparse tensor algebra. In this paper, we introduce DASTAC, a framework to propagate the tensors’s captured high-level structure down to low-level code generation by incorporating techniques such as automatic data layout compression, polyhedral analysis, and affine code generation. Our methodology reduces memory footprint by automatically detecting the best data layout, heavily benefits from polyhedral optimizations, leverages further optimizations, and enables parallelization through MLIR. Through extensive experimentation, we show that DASTAC can compete if not significantly outperform specialized hand-tuned implementation by experts. We observe 0.16x 44.83x and 1.37x - 243.78x speed-up for single- and multi-threaded cases, respectively.
Förderung
- Engineering and Physical Sciences Research Council
Zitieren
APA
Ghorbani, M., Bauer, E., Grosser, T., & Shaikhha, A. (2025). Compressed and Parallelized Structured Tensor Algebra. Proceedings of the ACM on Programming Languages, 9(OOPSLA1), 1717-1745. https://doi.org/10.1145/3720506
Vancouver
Ghorbani M, Bauer E, Grosser T, Shaikhha A. Compressed and Parallelized Structured Tensor Algebra. Proceedings of the ACM on Programming Languages. 2025;9(OOPSLA1):1717-1745. doi:10.1145/3720506
BibTeX
@article{Ghorbani2025,
author = {Ghorbani, Mahdi and Bauer, Emilien and Grosser, Tobias and Shaikhha, Amir},
title = {Compressed and Parallelized Structured Tensor Algebra},
journal = {Proceedings of the ACM on Programming Languages},
year = {2025},
volume = {9},
number = {OOPSLA1},
pages = {1717--1745},
doi = {10.1145/3720506}
}
EUVIMED