Improving batch schedulers with node stealing for failed jobs
Concurrency and Computation: Practice and Experience · 30.05.2024 · 36 (12)
DOI: 10.1002/cpe.8043 ↗Kurz gefasst
Fachartikel in der Zeitschrift Concurrency and Computation: Practice and Experience, online erschienen am 16.02.2024. Verfasst von Yishu Du und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 32 Literaturangaben.
Abstract (Originalsprache)
After a machine failure, batch schedulers typically re‐schedule the job that failed with a high priority. This is fair for the failed job but still requires that job to re‐enter the submission queue and to wait for enough resources to become available. The waiting time can be very long when the job is large and the platform highly loaded, as is the case with typical HPC platforms. We propose another strategy: when a job fails, if no platform node is available, we steal one node from another job , and use it to continue the execution of despite the failure. In this work, we give a detailed assessment of this node stealing strategy using traces from the Mira supercomputer at Argonne National Laboratory. The main conclusion is that node stealing improves the utilization of the platform and dramatically reduces the flow of large jobs, at the price of slightly increasing the flow of small jobs.
Zitieren
APA
Du, Y., Marchal, L., Pallez, G., & Robert, Y. (2024). Improving batch schedulers with node stealing for failed jobs. Concurrency and Computation: Practice and Experience, 36(12). https://doi.org/10.1002/cpe.8043
Vancouver
Du Y, Marchal L, Pallez G, Robert Y. Improving batch schedulers with node stealing for failed jobs. Concurrency and Computation: Practice and Experience. 2024;36(12). doi:10.1002/cpe.8043
BibTeX
@article{Du2024,
author = {Du, Yishu and Marchal, Loris and Pallez, Guillaume and Robert, Yves},
title = {Improving batch schedulers with node stealing for failed jobs},
journal = {Concurrency and Computation: Practice and Experience},
year = {2024},
volume = {36},
number = {12},
doi = {10.1002/cpe.8043}
}
EUVIMED