Optimizing Resource Management for Shared Microservices: A Scalable System Design
ACM Transactions on Computer Systems · 31.05.2024 · 42 (1-2) · 1-28
DOI: 10.1145/3631607 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Computer Systems, online erschienen am 13.02.2024. Verfasst von Shutian Luo und 7 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: Guangdong Key-Area Research and Development Program, National Natural Science Foundation of China, Science and Technology Development Fund of Macau.
Abstract (Originalsprache)
A common approach to improving resource utilization in data centers is to adaptively provision resources based on the actual workload. One fundamental challenge of doing this in microservice management frameworks, however, is that different components of a service can exhibit significant differences in their impact on end-to-end performance. To make resource management more challenging, a single microservice can be shared by multiple online services that have diverse workload patterns and SLA requirements. We present an efficient resource management system, namely Erms, for guaranteeing SLAs with high probability in shared microservice environments. Erms profiles microservice latency as a piece-wise linear function of the workload, resource usage, and interference. Based on this profiling, Erms builds resource scaling models to optimally determine latency targets for microservices with complex dependencies. Erms also designs new scheduling policies at shared microservices to further enhance resource efficiency. Experiments across microservice benchmarks as well as trace-driven simulations demonstrate that Erms can reduce SLA violation probability by 5× and more importantly, lead to a reduction in resource usage by 1.6×, compared to state-of-the-art approaches.
Förderung
- Guangdong Key-Area Research and Development Program
- National Natural Science Foundation of China
- Science and Technology Development Fund of Macau
- Guangdong Special Support Plan
- Alibaba Innovative Research Program
Zitieren
APA
Luo, S., Lin, C., Ye, K., Xu, G., Zhang, L., Yang, G., Xu, H., & Xu, C. (2024). Optimizing Resource Management for Shared Microservices: A Scalable System Design. ACM Transactions on Computer Systems, 42(1-2), 1-28. https://doi.org/10.1145/3631607
Vancouver
Luo S, Lin C, Ye K, Xu G, Zhang L, Yang G, et al. Optimizing Resource Management for Shared Microservices: A Scalable System Design. ACM Transactions on Computer Systems. 2024;42(1-2):1-28. doi:10.1145/3631607
BibTeX
@article{Luo2024,
author = {Luo, Shutian and Lin, Chenyu and Ye, Kejiang and Xu, Guoyao and Zhang, Liping and Yang, Guodong and Xu, Huanle and Xu, Chengzhong},
title = {Optimizing Resource Management for Shared Microservices: A Scalable System Design},
journal = {ACM Transactions on Computer Systems},
year = {2024},
volume = {42},
number = {1-2},
pages = {1--28},
doi = {10.1145/3631607}
}
EUVIMED