EUVIMEDEUVIMED entdecken
Crossref

An Evolutionary Overview of Large Language Models: From Statistical Methods to the Transformer Era

Boris Damnjanović, Dragan -, Dejan Simić, Negovan Stamenković

JITA - Journal of Information Technology and Applications (Banja Luka) - APEIRON · 2025 · 30 (2)

DOI: 10.7251/jit2502145d ↗

Kurz gefasst

Fachartikel in der Zeitschrift JITA - Journal of Information Technology and Applications (Banja Luka) - APEIRON, 2025. Verfasst von Boris Damnjanović und 3 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

While the early evolution of large language models (LLMs), including shift from statistical approaches to the Transformer architecture, illustrates their historical impact on the processing of natural language; however, the latest research in neural networks has enabled the faster and more powerful rise of language models grounded in solid theoretical foundations. These advantages, driven by advances in computing systems (e.g., ultra-powerful processing and memory capabilities), enable the development of numerous new models based on new emerging technologies such as artificial intelligence (AI). Thus, we provide an evolutionary overview of LLMs involved in the shift from the statistical to deep learning approach, highlighting their key stages of development, with a particular focused on concepts such as self-attention, the Transformer architecture, BERT, GPT, DeepSeek, and Claude. Finally, our conclusions present a reference point for future research associated with the emergence of new AI-supported models that are irreversibly transforming the way an increasing number of human activities are performed.

Zitieren

APA

Damnjanović, B., -, D., Simić, D., & Stamenković, N. (2025). An Evolutionary Overview of Large Language Models: From Statistical Methods to the Transformer Era. JITA - Journal of Information Technology and Applications (Banja Luka) - APEIRON, 30(2). https://doi.org/10.7251/jit2502145d

Vancouver

Damnjanović B, - D, Simić D, Stamenković N. An Evolutionary Overview of Large Language Models: From Statistical Methods to the Transformer Era. JITA - Journal of Information Technology and Applications (Banja Luka) - APEIRON. 2025;30(2). doi:10.7251/jit2502145d

BibTeX
@article{Damnjanovi2025,
  author = {Damnjanović, Boris and -, Dragan and Simić, Dejan and Stamenković, Negovan},
  title = {An Evolutionary Overview of Large Language Models: From Statistical Methods to the Transformer Era},
  journal = {JITA - Journal of Information Technology and Applications (Banja Luka) - APEIRON},
  year = {2025},
  volume = {30},
  number = {2},
  doi = {10.7251/jit2502145d}
}
Kostenlos starten →