Large Language Models Solving the European Diploma in Radiology: A Comparative Evaluation
Academic Radiology · 2026-05 · 33 (5) · 1871-1878
DOI: 10.1016/j.acra.2026.01.040 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Academic Radiology, 2026-05. Verfasst von Hamza Eren Güzel und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiology, Ministry of Health Izmir City Hospital, İzmir, Turkey (H.E.G.). Electronic address: hamzaerenguzel@gmail.com. Hauptthemen laut MEDLINE: Large Language Models, Radiology, Educational Measurement. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 17 Literaturangaben.
Abstract (Originalsprache)
RATIONALE AND OBJECTIVES: Rapid advancements in multimodal large language models (LLMs) highlight their expanding potential in radiology education and assessment. This study aims to evaluate and compare the performance of three state-of-the-art LLMs; GPT-5, Gemini 2.5 Pro, and Claude 4.5 Sonnet, using a complete, retired version of the European Diploma in Radiology (EDiR) examination. MATERIALS AND METHODS: The official EDiR examination, consisting of 78 Multiple Response Questions, 24 Short Cases, and 10 Clinically Oriented Reasoning Evaluation (CORE) cases, was administered to the models under standardized, zero-shot conditions. Inputs included text, static images, and videos (MP4 or sequential frames). Responses were scored according to official European Board of Radiology criteria. Passing thresholds were defined based on the historical human cohort mean for both the Weighted Written Score and the CORE component. RESULTS: In the written component (pass mark 50.9%), Gemini 2.5 Pro achieved the highest score (72.6%), followed by GPT-5 (67.3%), with both models surpassing the passing threshold. Claude 4.5 Sonnet scored 47.5%, failing to pass. In the CORE component (pass mark 55%), GPT-5 (62.5%) and Gemini 2.5 Pro (56.3%) successfully passed, whereas Claude 4.5 Sonnet (50.7%) did not. While models demonstrated high proficiency in text-dominant and static image interpretation, performance dropped in tasks requiring specific coordinate localization and dynamic video interpretation. CONCLUSION: GPT-5 and Gemini 2.5 Pro successfully met the passing criteria for the EDiR examination, demonstrating advanced capabilities suitable for educational augmentation. However, persistent limitations in spatial localization and temporal reasoning highlight that while semantic processing has matured, clinical visual grounding remains a challenge for autonomous deployment.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Radiology, Ministry of Health Izmir City Hospital, İzmir, Turkey (H.E.G.). Electronic address: hamzaerenguzel@gmail.com.
- Department of Radiology, Hospital Clínic de Barcelona, Barcelona 08036, Spain (L.O.).
- Department of Radiology, Ataturk Training and Research Hospital, Izmir Katip Celebi University, İzmir, Turkey (A.M.K.).
- European Board of Radiology, Barcelona 08008, Spain (V.J., C.M.).
Zitieren
APA
Güzel, H. E., Oleaga, L., Koç, A. M., Junquero, V., & Merino, C. (2026). Large Language Models Solving the European Diploma in Radiology: A Comparative Evaluation. Academic Radiology, 33(5), 1871-1878. https://doi.org/10.1016/j.acra.2026.01.040
Vancouver
Güzel HE, Oleaga L, Koç AM, Junquero V, Merino C. Large Language Models Solving the European Diploma in Radiology: A Comparative Evaluation. Academic Radiology. 2026;33(5):1871-1878. doi:10.1016/j.acra.2026.01.040
BibTeX
@article{Gzel2026,
author = {Güzel, Hamza Eren and Oleaga, Laura and Koç, Ali Murat and Junquero, Vanesa and Merino, Cristina},
title = {Large Language Models Solving the European Diploma in Radiology: A Comparative Evaluation},
journal = {Academic Radiology},
year = {2026},
volume = {33},
number = {5},
pages = {1871--1878},
doi = {10.1016/j.acra.2026.01.040}
}
EUVIMED