EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

When AI Meets Cache: Intelligent Memory Hierarchy Management in Modern CPUs

Yihan Wang, Suchuan Xing

Computer Life · 25.03.2026 · 14 (1) · 19-26

DOI: 10.54097/yd6k8n48 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Life, online erschienen am 25.03.2026. Verfasst von Yihan Wang und 1 weiteren Autor:innen. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The persistent and widening gap between processor execution speed and memory access latency—commonly termed the "memory wall"—has made efficient cache management one of the most consequential challenges in modern computer architecture. Traditional heuristic-based strategies such as least recently used (LRU), re-reference interval prediction (RRIP), and signature-based hit prediction (SHiP) have long served as foundations of cache control, yet they fundamentally fail to capture complex, application-specific, or workload-diverse memory access patterns. The rapid maturation of artificial intelligence (AI) and machine learning (ML) techniques now offers transformative opportunities to reimagine every tier of the memory hierarchy—from L1 instruction caches to last-level cache (LLC) partitioning and speculative hardware prefetching. This review surveys the state of the art at the intersection of AI and cache management, examining techniques including deep reinforcement learning (RL), long short-term memory (LSTM) networks, transformer-based sequence models, and graph neural networks (GNN) as applied to the three principal problem domains of cache replacement, hardware prefetching, and adaptive resource partitioning. We critically analyze trade-offs between prediction accuracy, inference latency, hardware overhead, and practical deployability, synthesizing empirical findings from recent simulation studies and silicon implementations. Key open challenges are identified, including online learning constraints, workload generalization, and the integration of AI inference within microarchitectural timing budgets.

Zitieren

APA

Wang, Y., & Xing, S. (2026). When AI Meets Cache: Intelligent Memory Hierarchy Management in Modern CPUs. Computer Life, 14(1), 19-26. https://doi.org/10.54097/yd6k8n48

Vancouver

Wang Y, Xing S. When AI Meets Cache: Intelligent Memory Hierarchy Management in Modern CPUs. Computer Life. 2026;14(1):19-26. doi:10.54097/yd6k8n48

BibTeX
@article{Wang2026,
  author = {Wang, Yihan and Xing, Suchuan},
  title = {When AI Meets Cache: Intelligent Memory Hierarchy Management in Modern CPUs},
  journal = {Computer Life},
  year = {2026},
  volume = {14},
  number = {1},
  pages = {19--26},
  doi = {10.54097/yd6k8n48}
}
Kostenlos starten →