EUVIMEDSkopri EUVIMED
Open access · CC BY 4.0

A Review of Large Language Models: Fundamental Architectures, Key Technological Evolutions, Interdisciplinary Technologies Integration, Optimization and Compression Techniques, Applications, and Challenges

Songyue Han, Mingyu Wang, Jialong Zhang, Dongdong Li, Junhong Duan

Electronics · 2024-12-21 · 13 (24) · 5040

DOI: 10.3390/electronics13245040 ↗

At a glance

Journal article in Electronics, published online on 2024-12-21. Written by Songyue Han and 4 co-authors. Cited 65 times so far (Crossref); 262 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China.

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Large language model-related technologies have shown astonishing potential in tasks such as machine translation, text generation, logical reasoning, task planning, and multimodal alignment. Consequently, their applications have continuously expanded from natural language processing to computer vision, scientific computing, and other vertical industry fields. This rapid surge in research work in a short period poses significant challenges for researchers to comprehensively grasp the research dynamics, understand key technologies, and develop applications in the field. To address this, this paper provides a comprehensive review of research on large language models. First, it organizes and reviews the research background and current status, clarifying the definition of large language models in both Chinese and English communities. Second, it analyzes the mainstream infrastructure of large language models and briefly introduces the key technologies and optimization methods that support them. Then, it conducts a detailed review of the intersections between large language models and interdisciplinary technologies such as contrastive learning, knowledge enhancement, retrieval enhancement, hallucination dissolution, recommendation systems, reinforcement learning, multimodal large models, and agents, pointing out valuable research ideas. Finally, it organizes the deployment and industry applications of large language models, identifies the limitations and challenges they face, and provides an outlook on future research directions. Our review paper aims not only to provide systematic research but also to focus on the integration of large language models with interdisciplinary technologies, hoping to provide ideas and inspiration for researchers to carry out industry applications and the secondary development of large language models.

Funding

  • National Natural Science Foundation of China

Cite

APA

Han, S., Wang, M., Zhang, J., Li, D., & Duan, J. (2024). A Review of Large Language Models: Fundamental Architectures, Key Technological Evolutions, Interdisciplinary Technologies Integration, Optimization and Compression Techniques, Applications, and Challenges. Electronics, 13(24), 5040. https://doi.org/10.3390/electronics13245040

Vancouver

Han S, Wang M, Zhang J, Li D, Duan J. A Review of Large Language Models: Fundamental Architectures, Key Technological Evolutions, Interdisciplinary Technologies Integration, Optimization and Compression Techniques, Applications, and Challenges. Electronics. 2024;13(24):5040. doi:10.3390/electronics13245040

BibTeX
@article{Han2024,
  author = {Han, Songyue and Wang, Mingyu and Zhang, Jialong and Li, Dongdong and Duan, Junhong},
  title = {A Review of Large Language Models: Fundamental Architectures, Key Technological Evolutions, Interdisciplinary Technologies Integration, Optimization and Compression Techniques, Applications, and Challenges},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {24},
  pages = {5040},
  doi = {10.3390/electronics13245040}
}
Start for free →