Failure-Aware Resource Allocation for Reliable Distributed Machine Learning Training
Academic Journal of Applied Sciences · 16.11.2026 · 3 (3) · 40-46
DOI: 10.54097/xqj1gs27 ↗Kurz gefasst
Fachartikel in der Zeitschrift Academic Journal of Applied Sciences, online erschienen am 16.11.2026. Verfasst von Eva van Dijk und 1 weiteren Autor:innen. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Long-running distributed training is exposed to worker failures and checkpoint overhead, yet lightweight GPU allocation rules often optimize failure-free throughput. This paper presents FARAS, a failure-aware resource allocation strategy that jointly selects checkpoint periods and allocates GPUs using estimated recoverable training progress. FARAS combines a per-worker failure hazard, nonlinear parallel speedup, checkpoint duration, and recovery delay in a marginal-goodput score. A minute-resolution Monte Carlo simulator evaluates five schedulers on synthetic batches of 14 training jobs sharing 24 GPUs, with 12 independently generated workload instances per condition. In the baseline failure setting, FARAS achieves a mean job completion time of 1,947.9 simulated minutes, compared with 2,037.8 for equal allocation with fixed checkpoints and 1,976.1 for size-aware allocation with adaptive checkpoints. These correspond to reductions of 4.41% and 1.42%, respectively. Across the tested failure intensities, FARAS consistently gives the lowest mean completion time among the examined policies. An additional paired experiment evaluates the impact of twofold underestimation and overestimation of worker failure hazards. The reported results describe synthetic system behavior rather than hardware measurements.
Zitieren
APA
Dijk, E. V., & Vries, M. D. (2026). Failure-Aware Resource Allocation for Reliable Distributed Machine Learning Training. Academic Journal of Applied Sciences, 3(3), 40-46. https://doi.org/10.54097/xqj1gs27
Vancouver
Dijk EV, Vries MD. Failure-Aware Resource Allocation for Reliable Distributed Machine Learning Training. Academic Journal of Applied Sciences. 2026;3(3):40-46. doi:10.54097/xqj1gs27
BibTeX
@article{Dijk2026,
author = {Dijk, Eva van and Vries, Matthijs de},
title = {Failure-Aware Resource Allocation for Reliable Distributed Machine Learning Training},
journal = {Academic Journal of Applied Sciences},
year = {2026},
volume = {3},
number = {3},
pages = {40--46},
doi = {10.54097/xqj1gs27}
}
EUVIMED