EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TAO: Re-Thinking DL-based Microarchitecture Simulation

Santosh Pandey, Amir Yazdanbakhsh, Hang Liu

Proceedings of the ACM on Measurement and Analysis of Computing Systems · 21.05.2024 · 8 (2) · 1-25

DOI: 10.1145/3656012 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Measurement and Analysis of Computing Systems, online erschienen am 29.05.2024. Verfasst von Santosh Pandey und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Microarchitecture simulators are indispensable tools for microarchitecture designers to validate, estimate, optimize, and manufacture new hardware that meets specific design requirements. While the quest for a fast, accurate and detailed microarchitecture simulation has been ongoing for decades, existing simulators excel and fall short at different aspects: (i) Although execution-driven simulation is accurate and detailed, it is extremely slow and requires expert-level experience to design. (ii) Trace-driven simulation reuses the execution traces in pursuit of fast simulation but faces accuracy concerns and fails to achieve significant speedup. (iii) Emerging deep learning (DL)-based simulations are remarkably fast and have acceptable accuracy, but fail to provide adequate low-level microarchitectural performance metrics such as branch mispredictions or cache misses, which is crucial for microarchitectural bottleneck analysis. Additionally, they introduce substantial overheads from trace regeneration and model re-training when simulating a new microarchitecture. Re-thinking the advantages and limitations of the aforementioned three mainstream simulation paradigms, this paper introduces TAO that redesigns the DL-based simulation with three primary contributions: First, we propose a new training dataset design such that the subsequent simulation (i.e., inference) only needs functional trace as inputs, which can be rapidly generated and reused across microarchitectures. Second, to increase the detail of the simulation, we redesign the input features and the DL model using self-attention to support predicting various performance metrics of interest. Third, we propose techniques to train a microarchitecture agnostic embedding layer that enables fast transfer learning between different microarchitectural configurations and effectively reduces the re-training overhead of conventional DL-based simulators. TAO can predict various performance metrics of interest, significantly reduce the simulation time, and maintain similar simulation accuracy as state-of-the-art DL-based endeavors. Our extensive evaluation shows TAO can reduce the overall training and simulation time by 18.06x over the state-of-the-art DL-based endeavors.

Förderung

  • NSF

Zitieren

APA

Pandey, S., Yazdanbakhsh, A., & Liu, H. (2024). TAO: Re-Thinking DL-based Microarchitecture Simulation. Proceedings of the ACM on Measurement and Analysis of Computing Systems, 8(2), 1-25. https://doi.org/10.1145/3656012

Vancouver

Pandey S, Yazdanbakhsh A, Liu H. TAO: Re-Thinking DL-based Microarchitecture Simulation. Proceedings of the ACM on Measurement and Analysis of Computing Systems. 2024;8(2):1-25. doi:10.1145/3656012

BibTeX
@article{Pandey2024,
  author = {Pandey, Santosh and Yazdanbakhsh, Amir and Liu, Hang},
  title = {TAO: Re-Thinking DL-based Microarchitecture Simulation},
  journal = {Proceedings of the ACM on Measurement and Analysis of Computing Systems},
  year = {2024},
  volume = {8},
  number = {2},
  pages = {1--25},
  doi = {10.1145/3656012}
}
Kostenlos starten →