Enhanced Scheduling of AI Applications in Multi-Tenant Cloud Using Genetic Optimizations
Applied Sciences · 29.05.2024 · 14 (11) · 4697
DOI: 10.3390/app14114697 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 29.05.2024. Verfasst von Seokmin Kwon und 1 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Institute of Information and Communications Technology Planning and Evaluation (IITP), Artificial Intelligence Convergence Innovation Human Resources Development (Ewha University).
Abstract (Originalsprache)
The artificial intelligence (AI) industry is increasingly integrating with diverse sectors such as smart logistics, FinTech, entertainment, and cloud computing. This expansion has led to the coexistence of heterogeneous applications within multi-tenant systems, presenting significant scheduling challenges. This paper addresses these challenges by exploring the scheduling of various machine learning workloads in large-scale, multi-tenant cloud systems that utilize heterogeneous GPUs. Traditional scheduling strategies often struggle to achieve satisfactory results due to low GPU utilization in these complex environments. To address this issue, we propose a novel scheduling approach that employs a genetic optimization technique, implemented within a process-oriented discrete-event simulation framework, to effectively orchestrate various machine learning tasks. We evaluate our approach using workload traces from Alibaba’s MLaaS cluster with over 6000 heterogeneous GPUs. The results show that our scheduling improves GPU utilization by 12.8% compared to Round-Robin scheduling, demonstrating the effectiveness of the solution in optimizing cloud-based GPU scheduling.
Förderung
- Institute of Information and Communications Technology Planning and Evaluation (IITP)
- Artificial Intelligence Convergence Innovation Human Resources Development (Ewha University)
Zitieren
APA
Kwon, S., & Bahn, H. (2024). Enhanced Scheduling of AI Applications in Multi-Tenant Cloud Using Genetic Optimizations. Applied Sciences, 14(11), 4697. https://doi.org/10.3390/app14114697
Vancouver
Kwon S, Bahn H. Enhanced Scheduling of AI Applications in Multi-Tenant Cloud Using Genetic Optimizations. Applied Sciences. 2024;14(11):4697. doi:10.3390/app14114697
BibTeX
@article{Kwon2024,
author = {Kwon, Seokmin and Bahn, Hyokyung},
title = {Enhanced Scheduling of AI Applications in Multi-Tenant Cloud Using Genetic Optimizations},
journal = {Applied Sciences},
year = {2024},
volume = {14},
number = {11},
pages = {4697},
doi = {10.3390/app14114697}
}
EUVIMED