DRS: A deep reinforcement learning enhanced Kubernetes scheduler for microservice‐based system
Software: Practice and Experience · 2024-10 · 54 (10) · 2102-2126
DOI: 10.1002/spe.3284 ↗Kurz gefasst
Fachartikel in der Zeitschrift Software: Practice and Experience, online erschienen am 25.10.2023. Verfasst von Zhaolong Jian und 7 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 45 Literaturangaben. Gefördert von: National Key Research and Development Program of China.
Abstract (Originalsprache)
Recently, Kubernetes is widely used to manage and schedule the resources of microservices in cloud‐native distributed applications, as the most famous container orchestration framework. However, Kubernetes preferentially schedules microservices to nodes with rich and balanced CPU and memory resources on a single node. The native scheduler of Kubernetes, called Kube‐scheduler, may cause resource fragmentation and decrease resource utilization. In this paper, we propose a deep reinforcement learning enhanced Kubernetes scheduler named DRS. We initially frame the Kubernetes scheduling problem as a Markov decision process with intricately designed state , action , and reward structures in an effort to increase resource usage and decrease load imbalance. Then, we design and implement DRS mointor to perceive six parameters concerning resource utilization and create a thorough picture of all available resources globally. Finally, DRS can automatically learn the scheduling policy through interaction with the Kubernetes cluster, without relying on expert knowledge about workload and cluster status. We implement a prototype of DRS in a Kubernetes cluster with five nodes and evaluate its performance. Experimental results highlight that DRS overcomes the shortcomings of Kube‐scheduler and achieves the expected scheduling target with three workloads. With only 3.27% CPU overhead and 0.648% communication delay, DRS outperforms Kube‐scheduler by 27.29% in terms of resource utilization and reduces load imbalance by 2.90 times on average.
Förderung
- National Key Research and Development Program of China
Zitieren
APA
Jian, Z., Xie, X., Fang, Y., Jiang, Y., Lu, Y., Dash, A., Li, T., & Wang, G. (2024). DRS: A deep reinforcement learning enhanced Kubernetes scheduler for microservice‐based system. Software: Practice and Experience, 54(10), 2102-2126. https://doi.org/10.1002/spe.3284
Vancouver
Jian Z, Xie X, Fang Y, Jiang Y, Lu Y, Dash A, et al. DRS: A deep reinforcement learning enhanced Kubernetes scheduler for microservice‐based system. Software: Practice and Experience. 2024;54(10):2102-2126. doi:10.1002/spe.3284
BibTeX
@article{Jian2024,
author = {Jian, Zhaolong and Xie, Xueshuo and Fang, Yaozheng and Jiang, Yibing and Lu, Ye and Dash, Ankan and Li, Tao and Wang, Guiling},
title = {DRS: A deep reinforcement learning enhanced Kubernetes scheduler for microservice‐based system},
journal = {Software: Practice and Experience},
year = {2024},
volume = {54},
number = {10},
pages = {2102--2126},
doi = {10.1002/spe.3284}
}
EUVIMED