EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Failure-Aware Resource Allocation for Reliable Distributed Machine Learning Training

Eva van Dijk, Matthijs de Vries

Academic Journal of Applied Sciences · 16.11.2026 · 3 (3) · 40-46

DOI: 10.54097/xqj1gs27 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Academic Journal of Applied Sciences, online erschienen am 16.11.2026. Verfasst von Eva van Dijk und 1 weiteren Autor:innen. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Long-running distributed training is exposed to worker failures and checkpoint overhead, yet lightweight GPU allocation rules often optimize failure-free throughput. This paper presents FARAS, a failure-aware resource allocation strategy that jointly selects checkpoint periods and allocates GPUs using estimated recoverable training progress. FARAS combines a per-worker failure hazard, nonlinear parallel speedup, checkpoint duration, and recovery delay in a marginal-goodput score. A minute-resolution Monte Carlo simulator evaluates five schedulers on synthetic batches of 14 training jobs sharing 24 GPUs, with 12 independently generated workload instances per condition. In the baseline failure setting, FARAS achieves a mean job completion time of 1,947.9 simulated minutes, compared with 2,037.8 for equal allocation with fixed checkpoints and 1,976.1 for size-aware allocation with adaptive checkpoints. These correspond to reductions of 4.41% and 1.42%, respectively. Across the tested failure intensities, FARAS consistently gives the lowest mean completion time among the examined policies. An additional paired experiment evaluates the impact of twofold underestimation and overestimation of worker failure hazards. The reported results describe synthetic system behavior rather than hardware measurements.

Zitieren

APA

Dijk, E. V., & Vries, M. D. (2026). Failure-Aware Resource Allocation for Reliable Distributed Machine Learning Training. Academic Journal of Applied Sciences, 3(3), 40-46. https://doi.org/10.54097/xqj1gs27

Vancouver

Dijk EV, Vries MD. Failure-Aware Resource Allocation for Reliable Distributed Machine Learning Training. Academic Journal of Applied Sciences. 2026;3(3):40-46. doi:10.54097/xqj1gs27

BibTeX
@article{Dijk2026,
  author = {Dijk, Eva van and Vries, Matthijs de},
  title = {Failure-Aware Resource Allocation for Reliable Distributed Machine Learning Training},
  journal = {Academic Journal of Applied Sciences},
  year = {2026},
  volume = {3},
  number = {3},
  pages = {40--46},
  doi = {10.54097/xqj1gs27}
}
Kostenlos starten →