EUVIMEDEUVIMED entdecken
Crossref

Adaptive Scheduling of Multimodal Large Language Model in Intelligent Edge Computing

Xingyu Yuan, He Li, Mianxiong Dong, Kaoru Ota

ACM Transactions on Autonomous and Adaptive Systems · 31.03.2026 · 21 (1) · 1-22

DOI: 10.1145/3774908 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Autonomous and Adaptive Systems, online erschienen am 10.03.2026. Verfasst von Xingyu Yuan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: Japan Society for the Promotion of Science, Japan Science and Technology Agency.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal Large Language Models (MLLMs) integrate multimodal encoders with Large Language Models (LLMs) to overcome the limitations of text-only models. Traditional LLMs are deployed on high-performance cloud servers, but MLLMs, which process multimodal data, face high transmission latency and privacy risks when tasks are offloaded to the cloud. Intelligent edge computing is a promising solution for supporting such latency-sensitive and privacy-sensitive tasks. However, the heterogeneity of edge environments makes efficient MLLM inference challenging. In this work, we enhance MLLM inference efficiency in heterogeneous edge environments by decoupling MLLM into LLM and multimodal encoders, deploying the LLM on high-performance devices and the multimodal encoders on lower-capability devices. Additionally, we observe that processing MLLM tasks in edge environments involves numerous configuration parameters that impact inference speed and energy consumption in an unknown and possibly time-varying fashion. To address this challenge, we present an adaptive scheduling algorithm that assigns parameters to tasks or minimizing energy consumption while meeting maximum latency constraints. The results of extensive experimental trials demonstrate that the proposed approach consistently outperforms existing state-of-the-art methods, achieving significant improvements in both latency reduction and energy efficiency.

Förderung

  • Japan Society for the Promotion of Science
  • Japan Science and Technology Agency

Zitieren

APA

Yuan, X., Li, H., Dong, M., & Ota, K. (2026). Adaptive Scheduling of Multimodal Large Language Model in Intelligent Edge Computing. ACM Transactions on Autonomous and Adaptive Systems, 21(1), 1-22. https://doi.org/10.1145/3774908

Vancouver

Yuan X, Li H, Dong M, Ota K. Adaptive Scheduling of Multimodal Large Language Model in Intelligent Edge Computing. ACM Transactions on Autonomous and Adaptive Systems. 2026;21(1):1-22. doi:10.1145/3774908

BibTeX
@article{Yuan2026,
  author = {Yuan, Xingyu and Li, He and Dong, Mianxiong and Ota, Kaoru},
  title = {Adaptive Scheduling of Multimodal Large Language Model in Intelligent Edge Computing},
  journal = {ACM Transactions on Autonomous and Adaptive Systems},
  year = {2026},
  volume = {21},
  number = {1},
  pages = {1--22},
  doi = {10.1145/3774908}
}
Kostenlos starten →