Generative AI at the Edge: A Comprehensive Survey of Architectures, Hardware and Applications
ACM Computing Surveys · 30.11.2026 · 58 (15) · 1-39
DOI: 10.1145/3829079 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 21.08.2026. Verfasst von Mozhgan Navardi und 5 weiteren Autor:innen. Die Arbeit nennt 239 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Generative Artificial Intelligence (GenAI) leverages generative models, including Diffusion models and Foundation Models (FMs) such as Large Language Models (LLMs), to generate new data. GenAI has attracted growing attention as it enables applications such as text generation, image synthesis, and multimodal reasoning. However, deploying such GenAI models on resource-constrained edge devices poses key challenges. Edge devices typically have limited computational power and strict energy budgets. They also face the memory-wall problem, where the cost of moving data between memory and compute units exceeds the cost of computation itself. This survey provides a comprehensive overview of techniques that enable GenAI deployment at the edge, covering software optimizations, hardware innovations, and system-level frameworks. While all three categories are discussed, particular emphasis is given to hardware-focused approaches. We review recent hardware studies and classify them into three main levels: computation, memory, and scheduling, with eight finer-grained subcategories that capture the mainstream hardware techniques. Many of these are hardware–software co-design strategies that align GenAI workloads with edge resource constraints. By synthesizing state-of-the-art solutions and identifying open challenges, this survey outlines a roadmap for building efficient GenAI systems at the edge.
Zitieren
APA
Navardi, M., Fu, Y., Lin, Y., Li, H., Chen, Y., & Mohsenin, T. (2026). Generative AI at the Edge: A Comprehensive Survey of Architectures, Hardware and Applications. ACM Computing Surveys, 58(15), 1-39. https://doi.org/10.1145/3829079
Vancouver
Navardi M, Fu Y, Lin Y, Li H, Chen Y, Mohsenin T. Generative AI at the Edge: A Comprehensive Survey of Architectures, Hardware and Applications. ACM Computing Surveys. 2026;58(15):1-39. doi:10.1145/3829079
BibTeX
@article{Navardi2026,
author = {Navardi, Mozhgan and Fu, Yuzhe and Lin, Yueqian and Li, Hai and Chen, Yiran and Mohsenin, Tinoosh},
title = {Generative AI at the Edge: A Comprehensive Survey of Architectures, Hardware and Applications},
journal = {ACM Computing Surveys},
year = {2026},
volume = {58},
number = {15},
pages = {1--39},
doi = {10.1145/3829079}
}
EUVIMED