Training Methods for Large Language Models: Current Approaches and Challenges
Technologies · 19.02.2026 · 14 (2) · 133
DOI: 10.3390/technologies14020133 ↗Kurz gefasst
Fachartikel in der Zeitschrift Technologies, online erschienen am 19.02.2026. Verfasst von Dimitris Karydas und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Special Account for Research Grants of the University of West Attica.
Abstract (Originalsprache)
Large Language Models (LLMs) have emerged as a dominant paradigm in natural language processing, demonstrating strong performance across a wide range of generation and reasoning tasks. These systems depend on multi-stage training pipelines that integrate large-scale self-supervised pre-training, supervised fine-tuning, and alignment techniques. This paper presents a systematic mapping study of contemporary LLM training methodologies, emphasizing transformer-based architectures, optimization objectives, and data curation strategies as well as emerging sparse architectures such as Mixture-of-Experts (MoE) models. We analyze parameter-efficient fine-tuning approaches, retrieval-augmented generation frameworks, and multimodal training techniques, which we organize into a unified comparative taxonomy. We discuss key technical challenges such as scalability constraints, hallucination, bias amplification, and alignment–capability tradeoffs, then identify emerging research directions such as reasoning-centric training. This work provides a concise technical reference for researchers and practitioners working on scalable and reliable language model training.
Förderung
- Special Account for Research Grants of the University of West Attica
Zitieren
APA
Karydas, D., Margaritis, D., & Leligou, H. C. (2026). Training Methods for Large Language Models: Current Approaches and Challenges. Technologies, 14(2), 133. https://doi.org/10.3390/technologies14020133
Vancouver
Karydas D, Margaritis D, Leligou HC. Training Methods for Large Language Models: Current Approaches and Challenges. Technologies. 2026;14(2):133. doi:10.3390/technologies14020133
BibTeX
@article{Karydas2026,
author = {Karydas, Dimitris and Margaritis, Dimosthenis and Leligou, Helen C.},
title = {Training Methods for Large Language Models: Current Approaches and Challenges},
journal = {Technologies},
year = {2026},
volume = {14},
number = {2},
pages = {133},
doi = {10.3390/technologies14020133}
}
EUVIMED