EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Training Methods for Large Language Models: Current Approaches and Challenges

Dimitris Karydas, Dimosthenis Margaritis, Helen C. Leligou

Technologies · 19.02.2026 · 14 (2) · 133

DOI: 10.3390/technologies14020133 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Technologies, online erschienen am 19.02.2026. Verfasst von Dimitris Karydas und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Special Account for Research Grants of the University of West Attica.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) have emerged as a dominant paradigm in natural language processing, demonstrating strong performance across a wide range of generation and reasoning tasks. These systems depend on multi-stage training pipelines that integrate large-scale self-supervised pre-training, supervised fine-tuning, and alignment techniques. This paper presents a systematic mapping study of contemporary LLM training methodologies, emphasizing transformer-based architectures, optimization objectives, and data curation strategies as well as emerging sparse architectures such as Mixture-of-Experts (MoE) models. We analyze parameter-efficient fine-tuning approaches, retrieval-augmented generation frameworks, and multimodal training techniques, which we organize into a unified comparative taxonomy. We discuss key technical challenges such as scalability constraints, hallucination, bias amplification, and alignment–capability tradeoffs, then identify emerging research directions such as reasoning-centric training. This work provides a concise technical reference for researchers and practitioners working on scalable and reliable language model training.

Förderung

  • Special Account for Research Grants of the University of West Attica

Zitieren

APA

Karydas, D., Margaritis, D., & Leligou, H. C. (2026). Training Methods for Large Language Models: Current Approaches and Challenges. Technologies, 14(2), 133. https://doi.org/10.3390/technologies14020133

Vancouver

Karydas D, Margaritis D, Leligou HC. Training Methods for Large Language Models: Current Approaches and Challenges. Technologies. 2026;14(2):133. doi:10.3390/technologies14020133

BibTeX
@article{Karydas2026,
  author = {Karydas, Dimitris and Margaritis, Dimosthenis and Leligou, Helen C.},
  title = {Training Methods for Large Language Models: Current Approaches and Challenges},
  journal = {Technologies},
  year = {2026},
  volume = {14},
  number = {2},
  pages = {133},
  doi = {10.3390/technologies14020133}
}
Kostenlos starten →