RL-CoPref: a reinforcement learning-based coordinated prefetching controller for multiple prefetchers
The Journal of Supercomputing · 2024-06 · 80 (9) · 13001-13026
DOI: 10.1007/s11227-024-05938-9 ↗At a glance
Journal article in The Journal of Supercomputing, published online on 2024-02-27. Written by Huijing Yang and 4 co-authors. Cited 17 times so far (Crossref); 63 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China, Natural Science Foundation of Beijing Municipality.
Abstract (original language)
Modern processors employ data prefetchers to alleviate the impact of long memory access latency. However, current prefetchers are designed for specific memory access patterns, which perform poorly on mixed applications with multiple memory access patterns. To address these issues, RL-CoPref, a reinforcement learning (RL)-based coordinated prefetching controller for multiple prefetchers, is proposed in this paper. RL-CoPref takes diverse program context information as the input, learns to maximize cumulative rewards, and evaluates prefetch quality based on prefetch hits/misses and memory bandwidth utilization. It can dynamically adjust the prefetch activation and prefetch degree, enabling multiple prefetchers to complement each other on mixed applications. Our extensive evaluation, utilizing the ChampSim simulator, demonstrates that RL-CoPref can effectively adapt to various workloads and system configurations, optimizing prefetch control. On average, RL-CoPref achieves 76.15% prefetch coverage, having 35.50% IPC improvement, outperforming state-of-the-art individual prefetchers by 5.91–16.54% and outperforming SBP, a state-of-the-art (non-RL) prefetch controller, by 4.64%.
Funding
- National Natural Science Foundation of China
- Natural Science Foundation of Beijing Municipality
Cite
APA
Yang, H., Fang, J., Su, X., Cai, Z., & Wang, Y. (2024). RL-CoPref: a reinforcement learning-based coordinated prefetching controller for multiple prefetchers. The Journal of Supercomputing, 80(9), 13001-13026. https://doi.org/10.1007/s11227-024-05938-9
Vancouver
Yang H, Fang J, Su X, Cai Z, Wang Y. RL-CoPref: a reinforcement learning-based coordinated prefetching controller for multiple prefetchers. The Journal of Supercomputing. 2024;80(9):13001-13026. doi:10.1007/s11227-024-05938-9
BibTeX
@article{Yang2024,
author = {Yang, Huijing and Fang, Juan and Su, Xing and Cai, Zhi and Wang, Yuening},
title = {RL-CoPref: a reinforcement learning-based coordinated prefetching controller for multiple prefetchers},
journal = {The Journal of Supercomputing},
year = {2024},
volume = {80},
number = {9},
pages = {13001--13026},
doi = {10.1007/s11227-024-05938-9}
}
EUVIMED