EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Generative AI at the Edge: A Comprehensive Survey of Architectures, Hardware and Applications

Mozhgan Navardi, Yuzhe Fu, Yueqian Lin, Hai Li, Yiran Chen, Tinoosh Mohsenin

ACM Computing Surveys · 30.11.2026 · 58 (15) · 1-39

DOI: 10.1145/3829079 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 21.08.2026. Verfasst von Mozhgan Navardi und 5 weiteren Autor:innen. Die Arbeit nennt 239 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Generative Artificial Intelligence (GenAI) leverages generative models, including Diffusion models and Foundation Models (FMs) such as Large Language Models (LLMs), to generate new data. GenAI has attracted growing attention as it enables applications such as text generation, image synthesis, and multimodal reasoning. However, deploying such GenAI models on resource-constrained edge devices poses key challenges. Edge devices typically have limited computational power and strict energy budgets. They also face the memory-wall problem, where the cost of moving data between memory and compute units exceeds the cost of computation itself. This survey provides a comprehensive overview of techniques that enable GenAI deployment at the edge, covering software optimizations, hardware innovations, and system-level frameworks. While all three categories are discussed, particular emphasis is given to hardware-focused approaches. We review recent hardware studies and classify them into three main levels: computation, memory, and scheduling, with eight finer-grained subcategories that capture the mainstream hardware techniques. Many of these are hardware–software co-design strategies that align GenAI workloads with edge resource constraints. By synthesizing state-of-the-art solutions and identifying open challenges, this survey outlines a roadmap for building efficient GenAI systems at the edge.

Zitieren

APA

Navardi, M., Fu, Y., Lin, Y., Li, H., Chen, Y., & Mohsenin, T. (2026). Generative AI at the Edge: A Comprehensive Survey of Architectures, Hardware and Applications. ACM Computing Surveys, 58(15), 1-39. https://doi.org/10.1145/3829079

Vancouver

Navardi M, Fu Y, Lin Y, Li H, Chen Y, Mohsenin T. Generative AI at the Edge: A Comprehensive Survey of Architectures, Hardware and Applications. ACM Computing Surveys. 2026;58(15):1-39. doi:10.1145/3829079

BibTeX
@article{Navardi2026,
  author = {Navardi, Mozhgan and Fu, Yuzhe and Lin, Yueqian and Li, Hai and Chen, Yiran and Mohsenin, Tinoosh},
  title = {Generative AI at the Edge: A Comprehensive Survey of Architectures, Hardware and Applications},
  journal = {ACM Computing Surveys},
  year = {2026},
  volume = {58},
  number = {15},
  pages = {1--39},
  doi = {10.1145/3829079}
}
Kostenlos starten →