Optimizing I/O Performance of HPC Applications with Autotuning
ACM Transactions on Parallel Computing · 31.12.2018 · 5 (4) · 1-27
DOI: 10.1145/3309205 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Parallel Computing, online erschienen am 08.03.2019. Verfasst von Babak Behzad und 3 weiteren Autor:innen. Die Arbeit wurde bisher 55-mal zitiert (Crossref) und nennt 55 Literaturangaben. Gefördert von: National Energy Research Scientific Computing Center, Texas Advanced Computing Center, Argonne Leadership Computing Facility at Argonne National Laboratory.
Abstract (Originalsprache)
Parallel Input output is an essential component of modern high-performance computing (HPC). Obtaining good I/O performance for a broad range of applications on diverse HPC platforms is a major challenge, in part, because of complex inter dependencies between I/O middleware and hardware. The parallel file system and I/O middleware layers all offer optimization parameters that can, in theory, result in better I/O performance. Unfortunately, the right combination of parameters is highly dependent on the application, HPC platform, problem size, and concurrency. Scientific application developers do not have the time or expertise to take on the substantial burden of identifying good parameters for each problem configuration. They resort to using system defaults, a choice that frequently results in poor I/O performance. We expect this problem to be compounded on exascale-class machines, which will likely have a deeper software stack with hierarchically arranged hardware resources. We present as a solution to this problem an autotuning system for optimizing I/O performance, I/O performance modeling, I/O tuning, and I/O patterns. We demonstrate the value of this framework across several HPC platforms and applications at scale.
Förderung
- National Energy Research Scientific Computing Center
- Texas Advanced Computing Center
- Argonne Leadership Computing Facility at Argonne National Laboratory
- Office of Science of the U.S. Department of Energy
- U.S. Department of Energy, Office of Science, Office of Advanced Scientific Computing Research
- NSF
Zitieren
APA
Behzad, B., Byna, S., Prabhat, & Snir, M. (2018). Optimizing I/O Performance of HPC Applications with Autotuning. ACM Transactions on Parallel Computing, 5(4), 1-27. https://doi.org/10.1145/3309205
Vancouver
Behzad B, Byna S, Prabhat, Snir M. Optimizing I/O Performance of HPC Applications with Autotuning. ACM Transactions on Parallel Computing. 2018;5(4):1-27. doi:10.1145/3309205
BibTeX
@article{Behzad2018,
author = {Behzad, Babak and Byna, Surendra and Prabhat and Snir, Marc},
title = {Optimizing I/O Performance of HPC Applications with Autotuning},
journal = {ACM Transactions on Parallel Computing},
year = {2018},
volume = {5},
number = {4},
pages = {1--27},
doi = {10.1145/3309205}
}
EUVIMED