Tyche: An Efficient and General Prefetcher for Indirect Memory Accesses
ACM Transactions on Architecture and Code Optimization · 30.06.2024 · 21 (2) · 1-26
DOI: 10.1145/3641853 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Architecture and Code Optimization, online erschienen am 23.03.2024. Verfasst von Feng Xue und 9 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 97 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China.
Abstract (Originalsprache)
Indirect memory accesses (IMAs, i.e., A [ f ( B [ i ])]) are typical memory access patterns in applications such as graph analysis, machine learning, and database. IMAs are composed of producer-consumer pairs, where the consumers’ memory addresses are derived from the producers’ memory data. Due to the built-in value-dependent feature, IMAs exhibit poor locality, making prefetching ineffective. Hindered by the challenges of recording the potentially complex graphs of instruction dependencies among IMA producers and consumers, current state-of-the-art hardware prefetchers either (a) exhibit inadequate IMA identification abilities or (b) rely on the run-ahead mechanism to prefetch IMAs intermittently and insufficiently. To solve this problem, we propose Tyche, 1 an efficient and general hardware prefetcher to enhance IMA performance. Tyche adopts a bilateral propagation mechanism to precisely excavate the instruction dependencies in simple chains with moderate length (rather than complex graphs). Based on the exact instruction dependencies, Tyche can accurately identify various IMA patterns, including nonlinear ones, and generate accurate prefetching requests continuously. Evaluated on broad benchmarks, Tyche achieves an average performance speedup of 16.2% over the state-of-the-art spatial prefetcher Berti. More importantly, Tyche outperforms the state-of-the-art IMA prefetchers IMP, Gretch, and Vector Runahead, by 15.9%, 12.8%, and 10.7%, respectively, with a lower storage overhead of only 0.57 KB.
Förderung
- National Key Research and Development Program of China
Zitieren
APA
Xue, F., Han, C., Li, X., Wu, J., Zhang, T., Liu, T., Hao, Y., Du, Z., Guo, Q., & Zhang, F. (2024). Tyche: An Efficient and General Prefetcher for Indirect Memory Accesses. ACM Transactions on Architecture and Code Optimization, 21(2), 1-26. https://doi.org/10.1145/3641853
Vancouver
Xue F, Han C, Li X, Wu J, Zhang T, Liu T, et al. Tyche: An Efficient and General Prefetcher for Indirect Memory Accesses. ACM Transactions on Architecture and Code Optimization. 2024;21(2):1-26. doi:10.1145/3641853
BibTeX
@article{Xue2024,
author = {Xue, Feng and Han, Chenji and Li, Xinyu and Wu, Junliang and Zhang, Tingting and Liu, Tianyi and Hao, Yifan and Du, Zidong and Guo, Qi and Zhang, Fuxin},
title = {Tyche: An Efficient and General Prefetcher for Indirect Memory Accesses},
journal = {ACM Transactions on Architecture and Code Optimization},
year = {2024},
volume = {21},
number = {2},
pages = {1--26},
doi = {10.1145/3641853}
}
EUVIMED