Auto-tuning for HPC storage stack: an optimization perspective
CCF Transactions on High Performance Computing · 2024-12 · 6 (6) · 608-631
DOI: 10.1007/s42514-024-00198-8 ↗Kurz gefasst
Fachartikel in der Zeitschrift CCF Transactions on High Performance Computing, online erschienen am 13.12.2024. Verfasst von Zhangyu Liu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 110 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Storage stack layers in high-performance computing (HPC) systems offer many tunable parameters controlling I/O behaviors and underlying file system settings. The setting of these parameters plays a decisive role in I/O performance. Nevertheless, the increasing complexity of data operations and storage architectures makes identifying a set of well-performing configurations a challenge. Auto-tuning is a promising technology. This paper presents a comprehensive survey on "Auto-tuning in HPC I/O". We expound a general storage structure based on a general storage stack and critical elements of auto-tuning, and categorize related studies according to the way of tuning. On the basis of the order in which the approaches were applied, we introduce the specific works of each approach in detail, and summarize and compare the pros and cons of these approaches. Through a comprehensive and in-depth study of existing research, we elaborate on the development history of auto-tuning technology in HPC I/O, analyze the current situation, and provide guidance for optimization technology in the future.
Zitieren
APA
Liu, Z., Wang, J., Wu, H., Ma, Q., Peng, L., & Tang, Z. (2024). Auto-tuning for HPC storage stack: an optimization perspective. CCF Transactions on High Performance Computing, 6(6), 608-631. https://doi.org/10.1007/s42514-024-00198-8
Vancouver
Liu Z, Wang J, Wu H, Ma Q, Peng L, Tang Z. Auto-tuning for HPC storage stack: an optimization perspective. CCF Transactions on High Performance Computing. 2024;6(6):608-631. doi:10.1007/s42514-024-00198-8
BibTeX
@article{Liu2024,
author = {Liu, Zhangyu and Wang, Jinqiu and Wu, Huijun and Ma, Qingzhen and Peng, Lin and Tang, Zhanyong},
title = {Auto-tuning for HPC storage stack: an optimization perspective},
journal = {CCF Transactions on High Performance Computing},
year = {2024},
volume = {6},
number = {6},
pages = {608--631},
doi = {10.1007/s42514-024-00198-8}
}
EUVIMED