EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey

Noah Lewis, Jean Luca Bez, Suren Byna

ACM Computing Surveys · 31.10.2025 · 57 (10) · 1-41

DOI: 10.1145/3722215 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 07.05.2025. Verfasst von Noah Lewis und 2 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 173 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research, National Energy Research Scientific Computing Center.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Growing interest in Artificial Intelligence (AI) has resulted in a surge in demand for faster methods of Machine Learning (ML) model training and inference. This demand for speed has prompted the use of high performance computing (HPC) systems that excel in managing distributed workloads. Because data is the main fuel for AI applications, the performance of the storage and I/O subsystem of HPC systems is critical. In the past, HPC applications accessed large portions of data written by simulations or experiments or ingested data for visualizations or analysis tasks. ML workloads perform small reads spread across a large number of random files. This shift of I/O access patterns poses several challenges to modern parallel storage systems. In this article, we survey I/O in ML applications on HPC systems, and target literature within a 6-year time window from 2019 to 2024. We define the scope of the survey, provide an overview of the common phases of ML, review available profilers and benchmarks, examine the I/O patterns encountered during offline data preparation, training, and inference, and explore I/O optimizations utilized in modern ML frameworks and proposed in recent literature. Lastly, we seek to expose research gaps that could spawn further R&D.

Förderung

  • U.S. Department of Energy
  • Office of Science, Office of Advanced Scientific Computing Research
  • National Energy Research Scientific Computing Center
  • Office of Science of the U.S. Department of Energy

Zitieren

APA

Lewis, N., Bez, J. L., & Byna, S. (2025). I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey. ACM Computing Surveys, 57(10), 1-41. https://doi.org/10.1145/3722215

Vancouver

Lewis N, Bez JL, Byna S. I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey. ACM Computing Surveys. 2025;57(10):1-41. doi:10.1145/3722215

BibTeX
@article{Lewis2025,
  author = {Lewis, Noah and Bez, Jean Luca and Byna, Suren},
  title = {I/O in Machine Learning Applications on HPC Systems: A 360-degree Survey},
  journal = {ACM Computing Surveys},
  year = {2025},
  volume = {57},
  number = {10},
  pages = {1--41},
  doi = {10.1145/3722215}
}
Kostenlos starten →