MPI malleability validation under replayed real-world HPC conditions
Future Generation Computer Systems · 2026-05 · 178 · 108305
DOI: 10.1016/j.future.2025.108305 ↗Kurz gefasst
Fachartikel in der Zeitschrift Future Generation Computer Systems, 2026-05. Verfasst von Sergio Iserte und 4 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 41 Literaturangaben. Gefördert von: European High Performance Computing Joint Undertaking, Generalitat de Catalunya, Ministerio de Ciencia e Innovación.
Abstract (Originalsprache)
Dynamic Resource Management (DRM) techniques can be leveraged to maximize throughput and resource utilization in computational clusters. Although DRM has been extensively studied through analytical workloads and simulations, skepticism persists among end administrators and users regarding their feasibility under real-world conditions. To address this problem, we propose a novel methodology for validating DRM techniques, such as malleability, in realistic scenarios that reproduce actual cluster conditions of jobs and users by replaying workload logs on a High-performance Computing (HPC) infrastructure. Our methodology is capable of adapting the workload to the target cluster. We evaluate our methodology in a malleability-enabled 125-node partition of the Marenostrum 5 supercomputer. Our results validate the proposed method and assess the benefits of MPI malleability on a novel use case of a pioneer user of malleability (our"PhD Student"): parallel efficiency-aware malleability reduced a malleable workload time by 27% without delaying the baseline workload, although introducing queueing delays for individual jobs, but maintaining the resource utilization rate.
Förderung
- European High Performance Computing Joint Undertaking
- Generalitat de Catalunya
- Ministerio de Ciencia e Innovación
- European Social Fund Plus
- Agencia Estatal de Investigación
- Spain Ministry of Science Innovation and Universities
Zitieren
APA
Iserte, S., Madon, M., Costa, G. D., Pierson, J., & Peña, A. J. (2026). MPI malleability validation under replayed real-world HPC conditions. Future Generation Computer Systems, 178, 108305. https://doi.org/10.1016/j.future.2025.108305
Vancouver
Iserte S, Madon M, Costa GD, Pierson J, Peña AJ. MPI malleability validation under replayed real-world HPC conditions. Future Generation Computer Systems. 2026;178:108305. doi:10.1016/j.future.2025.108305
BibTeX
@article{Iserte2026,
author = {Iserte, Sergio and Madon, Maël and Costa, Georges Da and Pierson, Jean-Marc and Peña, Antonio J.},
title = {MPI malleability validation under replayed real-world HPC conditions},
journal = {Future Generation Computer Systems},
year = {2026},
volume = {178},
pages = {108305},
doi = {10.1016/j.future.2025.108305}
}
EUVIMED