Towards Scalable Storage Architectures for GPU Clusters Running Large Language Models
ACM SIGMETRICS Performance Evaluation Review · 20.07.2026 · 54 (1) · 123-125
DOI: 10.1145/3820171.3806840 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM SIGMETRICS Performance Evaluation Review, online erschienen am 27.07.2026. Verfasst von Ali Sedaghatgoo und 3 weiteren Autor:innen. Die Arbeit nennt 6 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Accelerators in multi-GPU nodes increasingly sit idle due to storage and I/O inefficiencies. We present a phase-aware evaluation of storage datapaths for Large Language Models (LLMs) on single-node, multi-GPU systems, comparing libaio, io_uring, Storage Performance Development Kit (SPDK), and GPUDirect Storage (GDS) across SATA SSDs, NVMe SSDs, Optane NVMe, and Optane Persistent Memory. Using an automated framework, we test over 25,000 configurations and measure throughput, latency, Input Output Per Second (IOPS), and CPU overhead using workloads derived from real LLM traces spanning pre-training, fine-tuning, and inference. For inference workloads dominated by small random I/O, io_uring provides the best latency and competitive IOPS on NVMe devices. For pre-training and fine-tuning, which rely on large sequential transfers, GDS significantly reduces model load times and CPU usage. These findings show that optimal storage datapaths are phase-dependent and offer practical guidance for narrowing the storage--compute gap in GPU-based LLM systems.
Zitieren
APA
Sedaghatgoo, A., Salkhordeh, R., Brinkmann, A., & Asadi, H. (2026). Towards Scalable Storage Architectures for GPU Clusters Running Large Language Models. ACM SIGMETRICS Performance Evaluation Review, 54(1), 123-125. https://doi.org/10.1145/3820171.3806840
Vancouver
Sedaghatgoo A, Salkhordeh R, Brinkmann A, Asadi H. Towards Scalable Storage Architectures for GPU Clusters Running Large Language Models. ACM SIGMETRICS Performance Evaluation Review. 2026;54(1):123-125. doi:10.1145/3820171.3806840
BibTeX
@article{Sedaghatgoo2026,
author = {Sedaghatgoo, Ali and Salkhordeh, Reza and Brinkmann, André and Asadi, Hossein},
title = {Towards Scalable Storage Architectures for GPU Clusters Running Large Language Models},
journal = {ACM SIGMETRICS Performance Evaluation Review},
year = {2026},
volume = {54},
number = {1},
pages = {123--125},
doi = {10.1145/3820171.3806840}
}
EUVIMED