EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Modern Continual Learning with Foundation Models, Evaluation Challenges, and Future Directions

Zahid Ullah, Minki Hong, Jihie Kim

Mathematics · 03.08.2026 · 14 (15) · 2774

DOI: 10.3390/math14152774 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 03.08.2026. Verfasst von Zahid Ullah und 2 weiteren Autor:innen. Die Arbeit nennt 286 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: MSIT (Ministry of Science and ICT), Korea, IITP.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Continual learning (CL) aims to develop intelligent systems capable of learning continuously from sequential data while retaining previously acquired knowledge. As AI systems are increasingly deployed in dynamic real-world environments, CL has become essential for enabling long-term adaptation without catastrophic forgetting. This review provides a structured overview of major CL paradigms, including task-incremental, domain-incremental, class-incremental, online, multimodal, and federated CL. We examine the theoretical foundations of CL, particularly the stability–plasticity dilemma, catastrophic forgetting, transfer dynamics, and representation learning. In addition, we analyze major methodological categories, including regularization-based, replay-based, architecture-based, optimization-based, representation-learning, and parameter-efficient approaches. Recent developments involving transformers, prompt learning, foundation models, and multimodal adaptation are also discussed as emerging directions in modern CL research. Furthermore, this review highlights important issues related to benchmark fragmentation, evaluation inconsistency, memory constraints, computational efficiency, scalability, and privacy-aware learning. We also summarize key application domains, including computer vision, natural language processing, robotics, healthcare, and medical imaging. Finally, we identify open research challenges and future directions toward scalable, reliable, and deployment-oriented lifelong learning systems capable of operating effectively in continuously evolving environments.

Förderung

  • MSIT (Ministry of Science and ICT), Korea
  • IITP

Zitieren

APA

Ullah, Z., Hong, M., & Kim, J. (2026). Modern Continual Learning with Foundation Models, Evaluation Challenges, and Future Directions. Mathematics, 14(15), 2774. https://doi.org/10.3390/math14152774

Vancouver

Ullah Z, Hong M, Kim J. Modern Continual Learning with Foundation Models, Evaluation Challenges, and Future Directions. Mathematics. 2026;14(15):2774. doi:10.3390/math14152774

BibTeX
@article{Ullah2026,
  author = {Ullah, Zahid and Hong, Minki and Kim, Jihie},
  title = {Modern Continual Learning with Foundation Models, Evaluation Challenges, and Future Directions},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {15},
  pages = {2774},
  doi = {10.3390/math14152774}
}
Kostenlos starten →