EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Generalist large language models in a specialized world: Evidence from the Italian national medical education pathway

Tommaso Mario Buonocore iD, Antonio Russo, Dario Mingarelli, Enea Parimbelli

PLOS Digital Health · 24.04.2026 · 5 (4) · e0001363

DOI: 10.1371/journal.pdig.0001363 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Digital Health, online erschienen am 24.04.2026. Verfasst von Tommaso Mario Buonocore und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Creating language-specific and domain-specific large language models presents substantial challenges, including computational demands and limited data availability. While it is commonly believed that the benefits of specialized models justify these challenges, we dispute this notion with a comparative evaluation in a low-resourced language and medical-specific domain. In our study, we analyze the performance of various LLMs applied to the Italian healthcare domain using novel unpublished datasets, consisting of five-choice questions from national pre-university and post-university medical exams, covering clinical and preclinical fields. As part of this work, we release these datasets to the research community. We evaluated multilingual and Italian-specific models, along with general-purpose and healthcare-specific models, spanning both open-source and proprietary architectures of varying sizes. Our results demonstrate that multilingual, general-purpose large models consistently exceed the pass threshold across all tests, with the best models achieving over 90% accuracy on postgraduate-level exams. Model size emerged as the most critical factor influencing performance, whereas domain specialization and single-language localization offered no evidence of specialization superiority. These findings challenge the traditional pretrain-then-finetune paradigm for domain and language localization in language models, suggesting that advancements in generic-purpose multilingual models may render domain-specific pretraining unnecessary in many specialized cases.

Autor:innen und Institutionen

  • Department of Electrical, Computer and Biomedical Engineering, University of Pavia, Pavia, Italy.
  • R&D and Operations Departments - Consorzio Interuniversitario CINECA, Bologna, Italy.
  • Telfer School of Management, University of Ottawa, Ottawa, Canada.

ORCID-Profile: Tommaso Mario Buonocore

Zitieren

APA

Buonocore, T. M., Russo, A., Mingarelli, D., & Parimbelli, E. (2026). Generalist large language models in a specialized world: Evidence from the Italian national medical education pathway. PLOS Digital Health, 5(4), e0001363. https://doi.org/10.1371/journal.pdig.0001363

Vancouver

Buonocore TM, Russo A, Mingarelli D, Parimbelli E. Generalist large language models in a specialized world: Evidence from the Italian national medical education pathway. PLOS Digital Health. 2026;5(4):e0001363. doi:10.1371/journal.pdig.0001363

BibTeX
@article{Buonocore2026,
  author = {Buonocore, Tommaso Mario and Russo, Antonio and Mingarelli, Dario and Parimbelli, Enea},
  title = {Generalist large language models in a specialized world: Evidence from the Italian national medical education pathway},
  journal = {PLOS Digital Health},
  year = {2026},
  volume = {5},
  number = {4},
  pages = {e0001363},
  doi = {10.1371/journal.pdig.0001363}
}
Kostenlos starten →