EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhanced Scheduling of AI Applications in Multi-Tenant Cloud Using Genetic Optimizations

Seokmin Kwon, Hyokyung Bahn

Applied Sciences · 29.05.2024 · 14 (11) · 4697

DOI: 10.3390/app14114697 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 29.05.2024. Verfasst von Seokmin Kwon und 1 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Institute of Information and Communications Technology Planning and Evaluation (IITP), Artificial Intelligence Convergence Innovation Human Resources Development (Ewha University).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The artificial intelligence (AI) industry is increasingly integrating with diverse sectors such as smart logistics, FinTech, entertainment, and cloud computing. This expansion has led to the coexistence of heterogeneous applications within multi-tenant systems, presenting significant scheduling challenges. This paper addresses these challenges by exploring the scheduling of various machine learning workloads in large-scale, multi-tenant cloud systems that utilize heterogeneous GPUs. Traditional scheduling strategies often struggle to achieve satisfactory results due to low GPU utilization in these complex environments. To address this issue, we propose a novel scheduling approach that employs a genetic optimization technique, implemented within a process-oriented discrete-event simulation framework, to effectively orchestrate various machine learning tasks. We evaluate our approach using workload traces from Alibaba’s MLaaS cluster with over 6000 heterogeneous GPUs. The results show that our scheduling improves GPU utilization by 12.8% compared to Round-Robin scheduling, demonstrating the effectiveness of the solution in optimizing cloud-based GPU scheduling.

Förderung

  • Institute of Information and Communications Technology Planning and Evaluation (IITP)
  • Artificial Intelligence Convergence Innovation Human Resources Development (Ewha University)

Zitieren

APA

Kwon, S., & Bahn, H. (2024). Enhanced Scheduling of AI Applications in Multi-Tenant Cloud Using Genetic Optimizations. Applied Sciences, 14(11), 4697. https://doi.org/10.3390/app14114697

Vancouver

Kwon S, Bahn H. Enhanced Scheduling of AI Applications in Multi-Tenant Cloud Using Genetic Optimizations. Applied Sciences. 2024;14(11):4697. doi:10.3390/app14114697

BibTeX
@article{Kwon2024,
  author = {Kwon, Seokmin and Bahn, Hyokyung},
  title = {Enhanced Scheduling of AI Applications in Multi-Tenant Cloud Using Genetic Optimizations},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {11},
  pages = {4697},
  doi = {10.3390/app14114697}
}
Kostenlos starten →