EUVIMEDEUVIMED entdecken
Crossref

Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges

Senyao Li, Haozhao Wang, Wenchao Xu, Rui Zhang, Song Guo, Jingling Yuan, Xian Zhong, Tianwei Zhang, Ruixuan Li

ACM Computing Surveys · 24.08.2026

DOI: 10.1145/3838593 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 24.08.2026. Verfasst von Senyao Li und 8 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 268 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As large language models (LLMs) evolve, deploying them solely in the cloud or compressing them for edge devices is increasingly inadequate due to latency, privacy, cost, and personalization concerns. This survey examines a collaborative paradigm in which cloud-based LLMs and edge-deployed small language models (SLMs) cooperate for both inference and training. We propose a unified taxonomy of edge-cloud collaboration strategies. For inference, we categorize approaches into task assignment, task division, and mixture-based collaboration at both task- and token-levels, encompassing adaptive scheduling, resource-aware offloading, speculative decoding, and modular routing. For training, we review distributed adaptation techniques, including parameter alignment, pruning, bidirectional distillation, and small-model-guided optimization. We further summarize datasets, benchmarks, and deployment practices, and highlight privacy-preserving methods and vertical applications. This survey aims to establish a systematic foundation for LLM-SLM collaboration, bridging system-algorithm co-design toward efficient, scalable, and trustworthy edge-cloud intelligence.

Zitieren

APA

Li, S., Wang, H., Xu, W., Zhang, R., Guo, S., Yuan, J., Zhong, X., Zhang, T., & Li, R. (2026). Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges. ACM Computing Surveys. https://doi.org/10.1145/3838593

Vancouver

Li S, Wang H, Xu W, Zhang R, Guo S, Yuan J, et al. Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges. ACM Computing Surveys. 2026. doi:10.1145/3838593

BibTeX
@article{Li2026,
  author = {Li, Senyao and Wang, Haozhao and Xu, Wenchao and Zhang, Rui and Guo, Song and Yuan, Jingling and Zhong, Xian and Zhang, Tianwei and Li, Ruixuan},
  title = {Collaborative Inference and Learning between Edge SLMs and Cloud LLMs: A Survey of Algorithms, Execution, and Open Challenges},
  journal = {ACM Computing Surveys},
  year = {2026},
  doi = {10.1145/3838593}
}
Kostenlos starten →