EUVIMEDEUVIMED entdecken
Crossref

Deep Learning Workload Scheduling in GPU Datacenters: A Survey

Zhisheng Ye, Wei Gao, Qinghao Hu, Peng Sun, Xiaolin Wang, Yingwei Luo, Tianwei Zhang, Yonggang Wen

ACM Computing Surveys · 30.06.2024 · 56 (6) · 1-38

DOI: 10.1145/3638757 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 22.01.2024. Verfasst von Zhisheng Ye und 7 weiteren Autor:innen. Die Arbeit wurde bisher 142-mal zitiert (Crossref) und nennt 218 Literaturangaben. Gefördert von: National Key R&D Program of China, RIE2020 Industry Alignment Fund - Industry Collaboration Projects (IAF-ICP) Funding Initiative, National Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep learning (DL) has demonstrated its remarkable success in a wide variety of fields. The development of a DL model is a time-consuming and resource-intensive procedure. Hence, dedicated GPU accelerators have been collectively constructed into a GPU datacenter. An efficient scheduler design for a GPU datacenter is crucially important to reduce operational cost and improve resource utilization. However, traditional approaches designed for big data or high-performance computing workloads can not support DL workloads to fully utilize the GPU resources. Recently, many schedulers are proposed to tailor for DL workloads in GPU datacenters. This article surveys existing research efforts for both training and inference workloads. We primarily present how existing schedulers facilitate the respective workloads from the scheduling objectives and resource utilization manner . Finally, we discuss several promising future research directions including emerging DL workloads, advanced scheduling decision making, and underlying hardware resources. A more detailed summary of the surveyed paper and code links can be found at our project website: https://github.com/S-Lab-System-Group/Awesome-DL-Scheduling-Papers

Förderung

  • National Key R&D Program of China
  • RIE2020 Industry Alignment Fund - Industry Collaboration Projects (IAF-ICP) Funding Initiative
  • National Science Foundation of China

Zitieren

APA

Ye, Z., Gao, W., Hu, Q., Sun, P., Wang, X., Luo, Y., Zhang, T., & Wen, Y. (2024). Deep Learning Workload Scheduling in GPU Datacenters: A Survey. ACM Computing Surveys, 56(6), 1-38. https://doi.org/10.1145/3638757

Vancouver

Ye Z, Gao W, Hu Q, Sun P, Wang X, Luo Y, et al. Deep Learning Workload Scheduling in GPU Datacenters: A Survey. ACM Computing Surveys. 2024;56(6):1-38. doi:10.1145/3638757

BibTeX
@article{Ye2024,
  author = {Ye, Zhisheng and Gao, Wei and Hu, Qinghao and Sun, Peng and Wang, Xiaolin and Luo, Yingwei and Zhang, Tianwei and Wen, Yonggang},
  title = {Deep Learning Workload Scheduling in GPU Datacenters: A Survey},
  journal = {ACM Computing Surveys},
  year = {2024},
  volume = {56},
  number = {6},
  pages = {1--38},
  doi = {10.1145/3638757}
}
Kostenlos starten →