Large language models: A comprehensive survey of architectures, applications and challenges
Caliphate Journal of Science and Technology · 15.04.2026 · 8 (1) · 218-226
DOI: 10.4314/cajost.v8i1.23 ↗Kurz gefasst
Fachartikel in der Zeitschrift Caliphate Journal of Science and Technology, online erschienen am 15.04.2026. Verfasst von Ahmed I. Mahmud und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Large Language Models (LLMs) have emerged as a foundational technology in contemporary artificial intelligence, driven largely by the scalability and expressiveness of the Transformer architecture. This survey provides a structured and comprehensive review of recent advances in LLM research across five key dimensions: (i) scaling laws and foundational models, (ii) sparse and efficiency-oriented architectures, (iii) multimodal and tool-augmented models, (iv) privacy, alignment, and safety mechanisms, and (v) domain-specific applications and existing surveys. The reviewed literature indicates that while large-scale model training yields consistent performance gains and emergent capabilities, it also introduces significant challenges related to computational cost, energy consumption, interpretability, and environmental sustainability. Efficiency-driven approaches, including sparse attention mechanisms and Mixture-of-Experts architectures, mitigate some of these constraints but increase system complexity. Multimodal and tool-enhanced LLMs extend reasoning capabilities beyond text; however, they remain susceptible to hallucinations and grounding errors. Furthermore, alignment and privacy-preserving methods are actively evolving, yet the absence of standardized evaluation frameworks and clearly defined utility – safety trade-offs limit their practical deployment. Empirical studies in application domains such as healthcare and education demonstrate substantial promise but emphasize the necessity of trust, explainability, and regulatory compliance. This survey synthesizes current progress, identifies persistent research gaps, and outlines future directions toward the development of efficient, reliable, and responsible large language models.
Zitieren
APA
Mahmud, A. I., Aliyu, A., & Sani, U. (2026). Large language models: A comprehensive survey of architectures, applications and challenges. Caliphate Journal of Science and Technology, 8(1), 218-226. https://doi.org/10.4314/cajost.v8i1.23
Vancouver
Mahmud AI, Aliyu A, Sani U. Large language models: A comprehensive survey of architectures, applications and challenges. Caliphate Journal of Science and Technology. 2026;8(1):218-226. doi:10.4314/cajost.v8i1.23
BibTeX
@article{Mahmud2026,
author = {Mahmud, Ahmed I. and Aliyu, Ahmed and Sani, Umar},
title = {Large language models: A comprehensive survey of architectures, applications and challenges},
journal = {Caliphate Journal of Science and Technology},
year = {2026},
volume = {8},
number = {1},
pages = {218--226},
doi = {10.4314/cajost.v8i1.23}
}
EUVIMED