EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Towards Scalable Storage Architectures for GPU Clusters Running Large Language Models

Ali Sedaghatgoo, Reza Salkhordeh, André Brinkmann, Hossein Asadi

ACM SIGMETRICS Performance Evaluation Review · 20.07.2026 · 54 (1) · 123-125

DOI: 10.1145/3820171.3806840 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM SIGMETRICS Performance Evaluation Review, online erschienen am 27.07.2026. Verfasst von Ali Sedaghatgoo und 3 weiteren Autor:innen. Die Arbeit nennt 6 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accelerators in multi-GPU nodes increasingly sit idle due to storage and I/O inefficiencies. We present a phase-aware evaluation of storage datapaths for Large Language Models (LLMs) on single-node, multi-GPU systems, comparing libaio, io_uring, Storage Performance Development Kit (SPDK), and GPUDirect Storage (GDS) across SATA SSDs, NVMe SSDs, Optane NVMe, and Optane Persistent Memory. Using an automated framework, we test over 25,000 configurations and measure throughput, latency, Input Output Per Second (IOPS), and CPU overhead using workloads derived from real LLM traces spanning pre-training, fine-tuning, and inference. For inference workloads dominated by small random I/O, io_uring provides the best latency and competitive IOPS on NVMe devices. For pre-training and fine-tuning, which rely on large sequential transfers, GDS significantly reduces model load times and CPU usage. These findings show that optimal storage datapaths are phase-dependent and offer practical guidance for narrowing the storage--compute gap in GPU-based LLM systems.

Zitieren

APA

Sedaghatgoo, A., Salkhordeh, R., Brinkmann, A., & Asadi, H. (2026). Towards Scalable Storage Architectures for GPU Clusters Running Large Language Models. ACM SIGMETRICS Performance Evaluation Review, 54(1), 123-125. https://doi.org/10.1145/3820171.3806840

Vancouver

Sedaghatgoo A, Salkhordeh R, Brinkmann A, Asadi H. Towards Scalable Storage Architectures for GPU Clusters Running Large Language Models. ACM SIGMETRICS Performance Evaluation Review. 2026;54(1):123-125. doi:10.1145/3820171.3806840

BibTeX
@article{Sedaghatgoo2026,
  author = {Sedaghatgoo, Ali and Salkhordeh, Reza and Brinkmann, André and Asadi, Hossein},
  title = {Towards Scalable Storage Architectures for GPU Clusters Running Large Language Models},
  journal = {ACM SIGMETRICS Performance Evaluation Review},
  year = {2026},
  volume = {54},
  number = {1},
  pages = {123--125},
  doi = {10.1145/3820171.3806840}
}
Kostenlos starten →