EUVIMEDOdkrijte EUVIMED
Open access · CC BY 4.0

RL-CoPref: a reinforcement learning-based coordinated prefetching controller for multiple prefetchers

Huijing Yang, Juan Fang, Xing Su, Zhi Cai, Yuening Wang

The Journal of Supercomputing · 2024-06 · 80 (9) · 13001-13026

DOI: 10.1007/s11227-024-05938-9 ↗

At a glance

Journal article in The Journal of Supercomputing, published online on 2024-02-27. Written by Huijing Yang and 4 co-authors. Cited 17 times so far (Crossref); 63 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China, Natural Science Foundation of Beijing Municipality.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Modern processors employ data prefetchers to alleviate the impact of long memory access latency. However, current prefetchers are designed for specific memory access patterns, which perform poorly on mixed applications with multiple memory access patterns. To address these issues, RL-CoPref, a reinforcement learning (RL)-based coordinated prefetching controller for multiple prefetchers, is proposed in this paper. RL-CoPref takes diverse program context information as the input, learns to maximize cumulative rewards, and evaluates prefetch quality based on prefetch hits/misses and memory bandwidth utilization. It can dynamically adjust the prefetch activation and prefetch degree, enabling multiple prefetchers to complement each other on mixed applications. Our extensive evaluation, utilizing the ChampSim simulator, demonstrates that RL-CoPref can effectively adapt to various workloads and system configurations, optimizing prefetch control. On average, RL-CoPref achieves 76.15% prefetch coverage, having 35.50% IPC improvement, outperforming state-of-the-art individual prefetchers by 5.91–16.54% and outperforming SBP, a state-of-the-art (non-RL) prefetch controller, by 4.64%.

Funding

  • National Natural Science Foundation of China
  • Natural Science Foundation of Beijing Municipality

Cite

APA

Yang, H., Fang, J., Su, X., Cai, Z., & Wang, Y. (2024). RL-CoPref: a reinforcement learning-based coordinated prefetching controller for multiple prefetchers. The Journal of Supercomputing, 80(9), 13001-13026. https://doi.org/10.1007/s11227-024-05938-9

Vancouver

Yang H, Fang J, Su X, Cai Z, Wang Y. RL-CoPref: a reinforcement learning-based coordinated prefetching controller for multiple prefetchers. The Journal of Supercomputing. 2024;80(9):13001-13026. doi:10.1007/s11227-024-05938-9

BibTeX
@article{Yang2024,
  author = {Yang, Huijing and Fang, Juan and Su, Xing and Cai, Zhi and Wang, Yuening},
  title = {RL-CoPref: a reinforcement learning-based coordinated prefetching controller for multiple prefetchers},
  journal = {The Journal of Supercomputing},
  year = {2024},
  volume = {80},
  number = {9},
  pages = {13001--13026},
  doi = {10.1007/s11227-024-05938-9}
}
Start for free →