Hybrid Orchestration of AI Services and Microservices in Cloud-Edge Collaboration
IEEE Transactions on Mobile Computing · 2026-07 · 25 (7) · 9382-9400
DOI: 10.1109/tmc.2026.3654236 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2026-07. Verfasst von Kai Peng und 6 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Research and Development Program of Hubei Province, China.
Abstract (Originalsprache)
The rapid development of AI accelerates the implementation and delivery of AI applications in diverse fields. In cloud-edge collaboration, delivering a complete AI application relies on the robust coordination between AI-supporting microservices and AI services. However, most existing studies only coarsely considered monolithic AI service orchestration while neglecting microservice orchestration. Such coarse-grained orchestration severely impacts application performance. To enable diverse high-performance AI applications, fine-grained hybrid orchestration of AI services and microservices (HOAIM) is highly desirable, yet presents formidable challenges. Due to heterogeneous services, call dependencies, and service multiplexing, fine-grained hybrid orchestration modeling is highly non-trivial. Moreover, the tight coupling between deployment and routing results in a complex joint optimization problem. To address this, we first propose a heterogeneous service orchestration network that supports orchestration optimization and automated management. Then, based on queuing networks and multi-instance models, we conduct an accurate analysis of delay and load. Furthermore, to achieve efficient hybrid orchestration, we propose preference-driven resource allocation and instance computation algorithms, along with reinforcement learning with action masking and reward shaping. Finally, extensive trace-driven simulations demonstrate that our algorithms optimize average response delay by up to 41.83%, and achieve significant advantages in load balancing, response success rate, and resource efficiency.
Förderung
- National Natural Science Foundation of China
- Key Research and Development Program of Hubei Province, China
Zitieren
APA
Peng, K., Liu, X., Han, D., Hu, Y., Hu, M., Cai, C., & Xiong, Z. (2026). Hybrid Orchestration of AI Services and Microservices in Cloud-Edge Collaboration. IEEE Transactions on Mobile Computing, 25(7), 9382-9400. https://doi.org/10.1109/tmc.2026.3654236
Vancouver
Peng K, Liu X, Han D, Hu Y, Hu M, Cai C, et al. Hybrid Orchestration of AI Services and Microservices in Cloud-Edge Collaboration. IEEE Transactions on Mobile Computing. 2026;25(7):9382-9400. doi:10.1109/tmc.2026.3654236
BibTeX
@article{Peng2026,
author = {Peng, Kai and Liu, Xudong and Han, Di and Hu, Yi and Hu, Menglan and Cai, Chao and Xiong, Zehui},
title = {Hybrid Orchestration of AI Services and Microservices in Cloud-Edge Collaboration},
journal = {IEEE Transactions on Mobile Computing},
year = {2026},
volume = {25},
number = {7},
pages = {9382--9400},
doi = {10.1109/tmc.2026.3654236}
}
EUVIMED