EUVIMEDEUVIMED entdecken
Crossref

Collaborative Orchestration of Microservices and AI Services in Edges: A Dual-Time-Scale Reinforcement Learning Approach

Kai Peng, Junhui Hu, Zhiyu Wang, Yi Hu, Menglan Hu, Zehui Xiong, Zhe Chen

IEEE Transactions on Services Computing · 2026-05 · 19 (3) · 1977-1990

DOI: 10.1109/tsc.2026.3680248 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Services Computing, 2026-05. Verfasst von Kai Peng und 6 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 36 Literaturangaben. Gefördert von: Regional Innovation and Development Joint Fund, National Natural Science Foundation of China, Key Research and Development Program of Hubei Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid development of service computing has led to the emergence of scalable and flexible architectures such as microservices and Artificial Intelligence as a Service (AaaS), enabling the orchestration of AI-driven intelligent applications. However, existing work on intelligent applications orchestration overlooked essential microservice components that support AI services, resulting in coarse-grained and incomplete models. To ensure system integrity and enhance QoS, fine-grained collaborative orchestration of microservices and AI services is crucial. However, this poses significant challenges due to complex service dependencies, high request concurrency, and heterogeneous resource demands in edge environments. Moreover, the strong coupling between service deployment and request routing complicates their joint optimization, since effective decisions in one depend on the other. To address these challenges, we propose a collaborative orchestration framework that jointly optimizes the deployment of microservices and AI services along with probabilistic request routing in edge environments. We formulate the problem as a mixed-integer nonlinear program and leverage Jackson queuing networks for accurate delay modeling. To solve this, we develop a dual time scale hybrid greedy proximal policy optimization (DTS-HGPPO) algorithm that performs instance-level deployment and adaptive routing, enhanced with iterative instance planning, action masking and intrinsic motivation mechanisms. Extensive trace-driven experiments demonstrate that our method significantly reduces both response delay and service cost compared to state-of-the-art baselines.

Förderung

  • Regional Innovation and Development Joint Fund
  • National Natural Science Foundation of China
  • Key Research and Development Program of Hubei Province

Zitieren

APA

Peng, K., Hu, J., Wang, Z., Hu, Y., Hu, M., Xiong, Z., & Chen, Z. (2026). Collaborative Orchestration of Microservices and AI Services in Edges: A Dual-Time-Scale Reinforcement Learning Approach. IEEE Transactions on Services Computing, 19(3), 1977-1990. https://doi.org/10.1109/tsc.2026.3680248

Vancouver

Peng K, Hu J, Wang Z, Hu Y, Hu M, Xiong Z, et al. Collaborative Orchestration of Microservices and AI Services in Edges: A Dual-Time-Scale Reinforcement Learning Approach. IEEE Transactions on Services Computing. 2026;19(3):1977-1990. doi:10.1109/tsc.2026.3680248

BibTeX
@article{Peng2026,
  author = {Peng, Kai and Hu, Junhui and Wang, Zhiyu and Hu, Yi and Hu, Menglan and Xiong, Zehui and Chen, Zhe},
  title = {Collaborative Orchestration of Microservices and AI Services in Edges: A Dual-Time-Scale Reinforcement Learning Approach},
  journal = {IEEE Transactions on Services Computing},
  year = {2026},
  volume = {19},
  number = {3},
  pages = {1977--1990},
  doi = {10.1109/tsc.2026.3680248}
}
Kostenlos starten →