EUVIMEDEUVIMED entdecken
Crossref

History, development, and principles of large language models: an introductory survey

Zichong Wang, Zhibo Chu, Thang Viet Doan, Shiwen Ni, Min Yang, Wenbin Zhang

AI and Ethics · 2025-06 · 5 (3) · 1955-1971

DOI: 10.1007/s43681-024-00583-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift AI and Ethics, online erschienen am 14.10.2024. Verfasst von Zichong Wang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 100-mal zitiert (Crossref) und nennt 157 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Language models serve as a cornerstone in natural language processing, utilizing mathematical methods to generalize language laws and knowledge for prediction and generation. Over extensive research spanning decades, language modeling has progressed from initial statistical language models to the contemporary landscape of large language models (LLMs). Notably, the swift evolution of LLMs has reached the ability to process, understand, and generate human-level text. Nevertheless, despite the significant advantages that LLMs offer in improving both work and personal lives, the limited understanding among general practitioners about the background and principles of these models hampers their full potential. Notably, most LLM reviews focus on specific aspects and utilize specialized language, posing a challenge for practitioners lacking relevant background knowledge. In light of this, this survey aims to present a comprehensible overview of LLMs to assist a broader audience. It strives to facilitate a comprehensive understanding by exploring the historical background of language models and tracing their evolution over time. The survey further investigates the factors influencing the development of LLMs, emphasizing key contributions. Additionally, it concentrates on elucidating the underlying principles of LLMs, equipping audiences with essential theoretical knowledge. The survey also highlights the limitations of existing work and points out promising future directions.

Zitieren

APA

Wang, Z., Chu, Z., Doan, T. V., Ni, S., Yang, M., & Zhang, W. (2025). History, development, and principles of large language models: an introductory survey. AI and Ethics, 5(3), 1955-1971. https://doi.org/10.1007/s43681-024-00583-7

Vancouver

Wang Z, Chu Z, Doan TV, Ni S, Yang M, Zhang W. History, development, and principles of large language models: an introductory survey. AI and Ethics. 2025;5(3):1955-1971. doi:10.1007/s43681-024-00583-7

BibTeX
@article{Wang2025,
  author = {Wang, Zichong and Chu, Zhibo and Doan, Thang Viet and Ni, Shiwen and Yang, Min and Zhang, Wenbin},
  title = {History, development, and principles of large language models: an introductory survey},
  journal = {AI and Ethics},
  year = {2025},
  volume = {5},
  number = {3},
  pages = {1955--1971},
  doi = {10.1007/s43681-024-00583-7}
}
Kostenlos starten →