EUVIMEDEUVIMED entdecken
Crossref

Towards Incremental Learning in Large Language Models: A Critical Review

Mladjan Jovanovic, Peter Voss

Expert Systems · 2025-10 · 42 (10)

DOI: 10.1111/exsy.70127 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Expert Systems, online erschienen am 02.09.2025. Verfasst von Mladjan Jovanovic und 1 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 200 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Incremental learning is the ability of systems to acquire knowledge over time, enabling their adaptation and generalisation to novel tasks. It is a critical ability for intelligent, real‐world systems, especially when data changes frequently or is limited. This review provides a comprehensive analysis of incremental learning in large language models. It synthesises the state‐of‐the‐art incremental learning paradigms, including continual learning, meta‐learning, parameter‐efficient learning and mixture‐of‐experts learning. We demonstrate their utility for incremental learning by describing specific achievements from these related topics and their critical factors. An important finding is that many of these approaches do not update the core model, and none of them update incrementally in real time. The paper highlights current problems and challenges for future research in the field. By consolidating the latest relevant research developments, this review offers a comprehensive understanding of incremental learning and its implications for designing and developing LLM‐based learning systems.

Zitieren

APA

Jovanovic, M., & Voss, P. (2025). Towards Incremental Learning in Large Language Models: A Critical Review. Expert Systems, 42(10). https://doi.org/10.1111/exsy.70127

Vancouver

Jovanovic M, Voss P. Towards Incremental Learning in Large Language Models: A Critical Review. Expert Systems. 2025;42(10). doi:10.1111/exsy.70127

BibTeX
@article{Jovanovic2025,
  author = {Jovanovic, Mladjan and Voss, Peter},
  title = {Towards Incremental Learning in Large Language Models: A Critical Review},
  journal = {Expert Systems},
  year = {2025},
  volume = {42},
  number = {10},
  doi = {10.1111/exsy.70127}
}
Kostenlos starten →