EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Contemporary Approaches in Evolving Language Models

Dina Oralbekova, Orken Mamyrbayev, Mohamed Othman, Dinara Kassymova, Kuralai Mukhsina

Applied Sciences · 01.12.2023 · 13 (23) · 12901

DOI: 10.3390/app132312901 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 01.12.2023. Verfasst von Dina Oralbekova und 4 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 95 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science Committee of the Ministry of Science and Higher Education of the Republic of Kazakhstan.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article provides a comprehensive survey of contemporary language modeling approaches within the realm of natural language processing (NLP) tasks. This paper conducts an analytical exploration of diverse methodologies employed in the creation of language models. This exploration encompasses the architecture, training processes, and optimization strategies inherent in these models. The detailed discussion covers various models ranging from traditional n-gram and hidden Markov models to state-of-the-art neural network approaches such as BERT, GPT, LLAMA, and Bard. This article delves into different modifications and enhancements applied to both standard and neural network architectures for constructing language models. Special attention is given to addressing challenges specific to agglutinative languages within the context of developing language models for various NLP tasks, particularly for Arabic and Turkish. The research highlights that contemporary transformer-based methods demonstrate results comparable to those achieved by traditional methods employing Hidden Markov Models. These transformer-based approaches boast simpler configurations and exhibit faster performance during both training and analysis. An integral component of the article is the examination of popular and actively evolving libraries and tools essential for constructing language models. Notable tools such as NLTK, TensorFlow, PyTorch, and Gensim are reviewed, with a comparative analysis considering their simplicity and accessibility for implementing diverse language models. The aim is to provide readers with insights into the landscape of contemporary language modeling methodologies and the tools available for their implementation.

Förderung

  • Science Committee of the Ministry of Science and Higher Education of the Republic of Kazakhstan

Zitieren

APA

Oralbekova, D., Mamyrbayev, O., Othman, M., Kassymova, D., & Mukhsina, K. (2023). Contemporary Approaches in Evolving Language Models. Applied Sciences, 13(23), 12901. https://doi.org/10.3390/app132312901

Vancouver

Oralbekova D, Mamyrbayev O, Othman M, Kassymova D, Mukhsina K. Contemporary Approaches in Evolving Language Models. Applied Sciences. 2023;13(23):12901. doi:10.3390/app132312901

BibTeX
@article{Oralbekova2023,
  author = {Oralbekova, Dina and Mamyrbayev, Orken and Othman, Mohamed and Kassymova, Dinara and Mukhsina, Kuralai},
  title = {Contemporary Approaches in Evolving Language Models},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {23},
  pages = {12901},
  doi = {10.3390/app132312901}
}
Kostenlos starten →