EUVIMEDEUVIMED entdecken
Systematische ÜbersichtOpen Access · CC BY 4.0

State of the Art and Future Directions of Small Language Models: A Systematic Review

Flavio Corradini, Matteo Leonesi, Marco Piangerelli

Big Data and Cognitive Computing · 21.07.2025 · 9 (7) · 189

DOI: 10.3390/bdcc9070189 ↗

Kurz gefasst

Systematische Übersicht in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 21.07.2025. Verfasst von Flavio Corradini und 2 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 110 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Small Language Models (SLMs) have emerged as a critical area of study within natural language processing, attracting growing attention from both academia and industry. This systematic literature review provides a comprehensive and reproducible analysis of recent developments and advancements in SLMs post-2023. Drawing on 70 English-language studies published between January 2023 and January 2025, identified through Scopus, IEEE Xplore, Web of Science, and ACM Digital Library, and focusing primarily on SLMs (including those with up to 7 billion parameters), this review offers a structured overview of the current state of the art and potential future directions. Designed as a resource for researchers seeking an in-depth global synthesis, the review examines key dimensions such as publication trends, visual data representations, contributing institutions, and the availability of public datasets. It highlights prevailing research challenges and outlines proposed solutions, with a particular focus on widely adopted model architectures, as well as common compression and optimization techniques. This study also evaluates the criteria used to assess the effectiveness of SLMs and discusses emerging de facto standards for industry. The curated data and insights aim to support and inform ongoing and future research in this rapidly evolving field.

Förderung

  • European Union

Zitieren

APA

Corradini, F., Leonesi, M., & Piangerelli, M. (2025). State of the Art and Future Directions of Small Language Models: A Systematic Review. Big Data and Cognitive Computing, 9(7), 189. https://doi.org/10.3390/bdcc9070189

Vancouver

Corradini F, Leonesi M, Piangerelli M. State of the Art and Future Directions of Small Language Models: A Systematic Review. Big Data and Cognitive Computing. 2025;9(7):189. doi:10.3390/bdcc9070189

BibTeX
@article{Corradini2025,
  author = {Corradini, Flavio and Leonesi, Matteo and Piangerelli, Marco},
  title = {State of the Art and Future Directions of Small Language Models: A Systematic Review},
  journal = {Big Data and Cognitive Computing},
  year = {2025},
  volume = {9},
  number = {7},
  pages = {189},
  doi = {10.3390/bdcc9070189}
}
Kostenlos starten →