EUVIMEDEUVIMED entdecken
Crossref

Qualitatively Analyzing Optimization Objectives in the Design of HPC Resource Manager

Robin Boëzennec, Fanny Dufossé, Guillaume Pallez

ACM Transactions on Modeling and Performance Evaluation of Computing Systems · 31.12.2024 · 9 (4) · 1-28

DOI: 10.1145/3701986 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Modeling and Performance Evaluation of Computing Systems, online erschienen am 11.12.2024. Verfasst von Robin Boëzennec und 2 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 33 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A correct evaluation of scheduling algorithms and a good understanding of their optimization criteria are key components of resource management in HPC. In this work, we discuss bias and limitations of the most frequent optimization metrics from the literature. We provide elements on how to evaluate performance when studying HPC batch scheduling. We experimentally demonstrate these limitations by focusing on two use-cases: a study on the impact of runtime estimates on scheduling performance, and the reproduction of a recent high-impact work that designed an HPC batch scheduler based on a network trained with reinforcement learning. We demonstrate that focusing on quantitative optimization criterion (“our work improves the literature by X%”) may hide extremely important caveat, to the point that the results obtained are opposed to the actual goals of the authors. Key findings show that mean bounded slowdown and mean response time are hazardous for a purely quantitative analysis in the context of HPC. Despite some limitations, utilization appears to be a good objective. We propose to complement it with the standard deviation of the throughput in some pathological cases. Finally, we argue for a larger use of area-weighted response time, that we find to be a very relevant objective.

Zitieren

APA

Boëzennec, R., Dufossé, F., & Pallez, G. (2024). Qualitatively Analyzing Optimization Objectives in the Design of HPC Resource Manager. ACM Transactions on Modeling and Performance Evaluation of Computing Systems, 9(4), 1-28. https://doi.org/10.1145/3701986

Vancouver

Boëzennec R, Dufossé F, Pallez G. Qualitatively Analyzing Optimization Objectives in the Design of HPC Resource Manager. ACM Transactions on Modeling and Performance Evaluation of Computing Systems. 2024;9(4):1-28. doi:10.1145/3701986

BibTeX
@article{Bozennec2024,
  author = {Boëzennec, Robin and Dufossé, Fanny and Pallez, Guillaume},
  title = {Qualitatively Analyzing Optimization Objectives in the Design of HPC Resource Manager},
  journal = {ACM Transactions on Modeling and Performance Evaluation of Computing Systems},
  year = {2024},
  volume = {9},
  number = {4},
  pages = {1--28},
  doi = {10.1145/3701986}
}
Kostenlos starten →