EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Dynamic Pipeline Scheduling for Hybrid Edge Collaboration in Multi‐Modal LLM Inference

He Li

Artificial Intelligence for Engineering · 2026-06 · 2 (2) · 180-194

DOI: 10.1049/aie2.70020 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Artificial Intelligence for Engineering, online erschienen am 30.06.2026. Verfasst von He Li. Die Arbeit nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Japan Society for the Promotion of Science.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi‐modal large language models (MLLMs) are revolutionising AI‐enabled technologies, enabling more intelligent and human‐like multimedia data analysis. The application of MLLMs has the potential to accelerate processes while reducing human resource costs. However, the substantial computational overhead of supporting MLLMs poses challenges even during inference. This paper introduces a paradigm leveraging high‐performance low‐cost edge devices to enhance MLLM processing. The proposed approach employs in‐device and across‐device collaboration to improve overall system utilization and reduce MLLM inference latency. Additionally, a sophisticated multilevel pipeline scheduling method addresses bottlenecks in the edge system. Comprehensive experimental results demonstrate that the proposed system significantly accelerates MLLM inference for multi‐modal data processing.

Förderung

  • Japan Society for the Promotion of Science

Zitieren

APA

Li, H. (2026). Dynamic Pipeline Scheduling for Hybrid Edge Collaboration in Multi‐Modal LLM Inference. Artificial Intelligence for Engineering, 2(2), 180-194. https://doi.org/10.1049/aie2.70020

Vancouver

Li H. Dynamic Pipeline Scheduling for Hybrid Edge Collaboration in Multi‐Modal LLM Inference. Artificial Intelligence for Engineering. 2026;2(2):180-194. doi:10.1049/aie2.70020

BibTeX
@article{Li2026,
  author = {Li, He},
  title = {Dynamic Pipeline Scheduling for Hybrid Edge Collaboration in Multi‐Modal LLM Inference},
  journal = {Artificial Intelligence for Engineering},
  year = {2026},
  volume = {2},
  number = {2},
  pages = {180--194},
  doi = {10.1049/aie2.70020}
}
Kostenlos starten →