EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Review on Edge Large Language Models: Design, Execution, and Applications

Yue Zheng, Yuhao Chen, Bin Qian, Xiufang Shi, Yuanchao Shu, Jiming Chen

ACM Computing Surveys · 31.08.2025 · 57 (8) · 1-35

DOI: 10.1145/3719664 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 23.03.2025. Verfasst von Yue Zheng und 5 weiteren Autor:innen. Die Arbeit wurde bisher 181-mal zitiert (Crossref) und nennt 234 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Key Research and Development Program of Zhejiang Province, ZJUCSE-Enflame cloud and edge intelligence joint laboratory.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) have revolutionized natural language processing with their exceptional understanding, synthesizing, and reasoning capabilities. However, deploying LLMs on resource-constrained edge devices presents significant challenges due to computational limitations, memory constraints, and edge hardware heterogeneity. This survey provides a comprehensive overview of recent advancements in edge LLMs, covering the entire lifecycle—from resource-efficient model design and pre-deployment strategies to runtime inference optimizations. It also explores on-device applications across various domains. By synthesizing state-of-the-art techniques and identifying future research directions, this survey bridges the gap between the immense potential of LLMs and the constraints of edge computing.

Förderung

  • National Natural Science Foundation of China
  • Key Research and Development Program of Zhejiang Province
  • ZJUCSE-Enflame cloud and edge intelligence joint laboratory

Zitieren

APA

Zheng, Y., Chen, Y., Qian, B., Shi, X., Shu, Y., & Chen, J. (2025). A Review on Edge Large Language Models: Design, Execution, and Applications. ACM Computing Surveys, 57(8), 1-35. https://doi.org/10.1145/3719664

Vancouver

Zheng Y, Chen Y, Qian B, Shi X, Shu Y, Chen J. A Review on Edge Large Language Models: Design, Execution, and Applications. ACM Computing Surveys. 2025;57(8):1-35. doi:10.1145/3719664

BibTeX
@article{Zheng2025,
  author = {Zheng, Yue and Chen, Yuhao and Qian, Bin and Shi, Xiufang and Shu, Yuanchao and Chen, Jiming},
  title = {A Review on Edge Large Language Models: Design, Execution, and Applications},
  journal = {ACM Computing Surveys},
  year = {2025},
  volume = {57},
  number = {8},
  pages = {1--35},
  doi = {10.1145/3719664}
}
Kostenlos starten →