Dynamic Pipeline Scheduling for Hybrid Edge Collaboration in Multi‐Modal LLM Inference
Artificial Intelligence for Engineering · 2026-06 · 2 (2) · 180-194
DOI: 10.1049/aie2.70020 ↗Kurz gefasst
Fachartikel in der Zeitschrift Artificial Intelligence for Engineering, online erschienen am 30.06.2026. Verfasst von He Li. Die Arbeit nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Japan Society for the Promotion of Science.
Abstract (Originalsprache)
Multi‐modal large language models (MLLMs) are revolutionising AI‐enabled technologies, enabling more intelligent and human‐like multimedia data analysis. The application of MLLMs has the potential to accelerate processes while reducing human resource costs. However, the substantial computational overhead of supporting MLLMs poses challenges even during inference. This paper introduces a paradigm leveraging high‐performance low‐cost edge devices to enhance MLLM processing. The proposed approach employs in‐device and across‐device collaboration to improve overall system utilization and reduce MLLM inference latency. Additionally, a sophisticated multilevel pipeline scheduling method addresses bottlenecks in the edge system. Comprehensive experimental results demonstrate that the proposed system significantly accelerates MLLM inference for multi‐modal data processing.
Förderung
- Japan Society for the Promotion of Science
Zitieren
APA
Li, H. (2026). Dynamic Pipeline Scheduling for Hybrid Edge Collaboration in Multi‐Modal LLM Inference. Artificial Intelligence for Engineering, 2(2), 180-194. https://doi.org/10.1049/aie2.70020
Vancouver
Li H. Dynamic Pipeline Scheduling for Hybrid Edge Collaboration in Multi‐Modal LLM Inference. Artificial Intelligence for Engineering. 2026;2(2):180-194. doi:10.1049/aie2.70020
BibTeX
@article{Li2026,
author = {Li, He},
title = {Dynamic Pipeline Scheduling for Hybrid Edge Collaboration in Multi‐Modal LLM Inference},
journal = {Artificial Intelligence for Engineering},
year = {2026},
volume = {2},
number = {2},
pages = {180--194},
doi = {10.1049/aie2.70020}
}
EUVIMED