A Comprehensive Overview of Large Language Models
ACM Transactions on Intelligent Systems and Technology · 31.10.2025 · 16 (5) · 1-72
DOI: 10.1145/3744746 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Intelligent Systems and Technology, online erschienen am 18.08.2025. Verfasst von Humza Naveed und 8 weiteren Autor:innen. Die Arbeit wurde bisher 891-mal zitiert (Crossref) und nennt 513 Literaturangaben.
Abstract (Originalsprache)
Large Language Models (LLMs) have recently demonstrated remarkable capabilities in natural language processing tasks and beyond. This success of LLMs has led to a large influx of research contributions in this direction. These works encompass diverse topics such as architectural innovations, better training strategies, context length improvements, fine-tuning, multimodal LLMs, robotics, datasets, benchmarking, efficiency, and more. With the rapid development of techniques and regular breakthroughs in LLM research, it has become considerably challenging to perceive the bigger picture of the advances in this direction. Considering the rapidly emerging plethora of literature on LLMs, it is imperative that the research community is able to benefit from a concise yet comprehensive overview of the recent developments in this field. This article provides an overview of the literature on a broad range of LLM-related concepts. Our self-contained comprehensive overview of LLMs discusses relevant background concepts along with covering the advanced topics at the frontier of research in LLMs. This review article is intended to provide not only a systematic survey but also a quick, comprehensive reference for the researchers and practitioners to draw insights from extensive, informative summaries of the existing works to advance the LLM research.
Zitieren
APA
Naveed, H., Khan, A. U., Qiu, S., Saqib, M., Anwar, S., Usman, M., Akhtar, N., Barnes, N., & Mian, A. (2025). A Comprehensive Overview of Large Language Models. ACM Transactions on Intelligent Systems and Technology, 16(5), 1-72. https://doi.org/10.1145/3744746
Vancouver
Naveed H, Khan AU, Qiu S, Saqib M, Anwar S, Usman M, et al. A Comprehensive Overview of Large Language Models. ACM Transactions on Intelligent Systems and Technology. 2025;16(5):1-72. doi:10.1145/3744746
BibTeX
@article{Naveed2025,
author = {Naveed, Humza and Khan, Asad Ullah and Qiu, Shi and Saqib, Muhammad and Anwar, Saeed and Usman, Muhammad and Akhtar, Naveed and Barnes, Nick and Mian, Ajmal},
title = {A Comprehensive Overview of Large Language Models},
journal = {ACM Transactions on Intelligent Systems and Technology},
year = {2025},
volume = {16},
number = {5},
pages = {1--72},
doi = {10.1145/3744746}
}
EUVIMED