EUVIMEDEUVIMED entdecken
Crossref

Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis

Weile Luo, Ruibo Fan, Zeyu Li, Dayou Du, Hongyuan Liu, Qiang Wang, Xiaowen Chu

ACM Transactions on Computer Systems · 05.10.2026

DOI: 10.1145/3856813 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Computer Systems, online erschienen am 05.10.2026. Verfasst von Weile Luo und 6 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 62 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study presents a comprehensive multi-level analysis of the NVIDIA Hopper GPU architecture, focusing on its performance characteristics and novel features. We benchmark Hopper’s memory subsystem, highlighting improvements in the L2 partitioned cache and global memory access compared to Ampere and Ada Lovelace. The evaluation of Hopper’s fourth-generation tensor cores reveals the benefits of FP8 precision and asynchronous wgmma instructions for matrix operations. Additionally, we investigate the performance of DPX instructions for dynamic programming, distributed shared memory (DSM) for inter-SM communication, and the Tensor Memory Accelerator (TMA) for asynchronous data movement. Through multi-level evaluation, we discover that the Hopper architecture demonstrates significant acceleration potential in real-world applications. For instance, the asynchronous programming model supported by TMA achieves a 1.5× speedup in matrix multiplication, FP8 delivers nearly double the performance of FP16, and DPX instructions accelerate a computational biology algorithm by at least 4.75×. Our findings provide actionable insights for optimizing compute-intensive workloads, from AI training to bioinformatics, on Hopper GPUs.

Zitieren

APA

Luo, W., Fan, R., Li, Z., Du, D., Liu, H., Wang, Q., & Chu, X. (2026). Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis. ACM Transactions on Computer Systems. https://doi.org/10.1145/3856813

Vancouver

Luo W, Fan R, Li Z, Du D, Liu H, Wang Q, et al. Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis. ACM Transactions on Computer Systems. 2026. doi:10.1145/3856813

BibTeX
@article{Luo2026,
  author = {Luo, Weile and Fan, Ruibo and Li, Zeyu and Du, Dayou and Liu, Hongyuan and Wang, Qiang and Chu, Xiaowen},
  title = {Dissecting the NVIDIA Hopper Architecture through Microbenchmarking and Multiple Level Analysis},
  journal = {ACM Transactions on Computer Systems},
  year = {2026},
  doi = {10.1145/3856813}
}
Kostenlos starten →