A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models
IEEE Circuits and Systems Magazine · 2025 · 25 (1) · 35-57
DOI: 10.1109/mcas.2024.3476008 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Circuits and Systems Magazine, 2025. Verfasst von Cong Guo und 22 weiteren Autor:innen. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 219 Literaturangaben.
Abstract (Originalsprache)
The rapid development of large language models (LLMs) has significantly transformed the field of artificial intelligence, demonstrating remarkable capabilities in natural language processing and moving towards multi-modal functionality. These models are increasingly integrated into diverse applications, impacting both research and industry. However, their development and deployment present substantial challenges, including the need for extensive computational resources, high energy consumption, and complex software optimizations. Unlike traditional deep learning systems, LLMs require unique optimization strategies for training and inference, focusing on system-level efficiency. This paper surveys hardware and software co-design approaches specifically tailored to address the unique characteristics and constraints of large language models. This survey analyzes the challenges and impacts of LLMs on hardware and algorithm research, exploring algorithm optimization, hardware design, and system-level innovations. It aims to provide a comprehensive understanding of the trade-offs and considerations in LLM-centric computing systems, guiding future advancements in AI. Finally, we summarize the existing efforts in this space and outline future directions toward realizing production-grade co-design methodologies for the next generation of large language models and AI systems.
Zitieren
APA
Guo, C., Cheng, F., Du, Z., Kiessling, J., Ku, J., Li, S., Li, Z., Ma, M., Molom-Ochir, T., Morris, B., Shan, H., Sun, J., Wang, Y., Wei, C., Wu, X., Wu, Y., Yang, H. F., Zhang, J., Zhang, J., …, & Chen, Y. (2025). A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models. IEEE Circuits and Systems Magazine, 25(1), 35-57. https://doi.org/10.1109/mcas.2024.3476008
Vancouver
Guo C, Cheng F, Du Z, Kiessling J, Ku J, Li S, et al. A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models. IEEE Circuits and Systems Magazine. 2025;25(1):35-57. doi:10.1109/mcas.2024.3476008
BibTeX
@article{Guo2025,
author = {Guo, Cong and Cheng, Feng and Du, Zhixu and Kiessling, James and Ku, Jonathan and Li, Shiyu and Li, Ziru and Ma, Mingyuan and Molom-Ochir, Tergel and Morris, Benjamin and Shan, Haoxuan and Sun, Jingwei and Wang, Yitu and Wei, Chiyue and Wu, Xueying and Wu, Yuhao and Yang, Hao Frank and Zhang, Jingyang and Zhang, Junyao and Zheng, Qilin and Zhou, Guanglei and Li, Hai and Chen, Yiran},
title = {A Survey: Collaborative Hardware and Software Design in the Era of Large Language Models},
journal = {IEEE Circuits and Systems Magazine},
year = {2025},
volume = {25},
number = {1},
pages = {35--57},
doi = {10.1109/mcas.2024.3476008}
}
EUVIMED