Assessment of large language models in musculoskeletal radiological anatomy: A comparative study with radiologists
Joint Diseases and Related Surgery · 23.09.2025
DOI: 10.52312/jdrs.2026.2436 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Joint Diseases and Related Surgery, online erschienen am 23.09.2025. Verfasst von Ali Salbas und 1 weiteren Autor:innen. Beteiligte Einrichtung: Atatürk Eğitim ve Araştırma Hastanesi, Radyoloji Kliniği, 35150 Karabaglar, İzmir, Türkiye. dralisalbas@gmail.com. Hauptthemen laut MEDLINE: Musculoskeletal System, Radiologists, Language. Die Arbeit wurde bisher 6-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
OBJECTIVES: This study aims to evaluate the diagnostic performance of large language models (LLMs) in musculoskeletal radiological anatomy and to compare their accuracy with radiologists of varying experience levels. PATIENTS AND METHODS: Between May 16, 2025 and June 12, 2025, a total of 175 multiple-choice questions (82 image-based, 93 text-only) were retrieved from Radiopaedia's open-access database. Questions were classified by anatomical region and imaging modality. Three LLMs, ChatGPT-4o (OpenAI), Claude 3.7 Sonnet (Anthropic), and Grok 3 (×AI), were assessed in a zero-shot setting. Their responses were compared to those of an attending musculoskeletal radiologist and two residents (senior and junior). Accuracy rates were calculated and statistically compared. RESULTS: The attending radiologist achieved the highest overall accuracy (79.4%), followed by the senior (72.6%) and junior resident (66.9%). Among LLMs, ChatGPT-4o performed best overall (69.7%), particularly in text-based questions (88.2%). All LLMs outperformed radiologists in text-based questions but underperformed in image-based ones. The attending radiologist significantly outperformed all LLMs in image interpretation (p
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Atatürk Eğitim ve Araştırma Hastanesi, Radyoloji Kliniği, 35150 Karabaglar, İzmir, Türkiye. dralisalbas@gmail.com.
Zitieren
APA
Salbas, A., & Baysan, E. K. (2025). Assessment of large language models in musculoskeletal radiological anatomy: A comparative study with radiologists. Joint Diseases and Related Surgery. https://doi.org/10.52312/jdrs.2026.2436
Vancouver
Salbas A, Baysan EK. Assessment of large language models in musculoskeletal radiological anatomy: A comparative study with radiologists. Joint Diseases and Related Surgery. 2025. doi:10.52312/jdrs.2026.2436
BibTeX
@article{Salbas2025,
author = {Salbas, Ali and Baysan, Ebru Kul},
title = {Assessment of large language models in musculoskeletal radiological anatomy: A comparative study with radiologists},
journal = {Joint Diseases and Related Surgery},
year = {2025},
doi = {10.52312/jdrs.2026.2436}
}
EUVIMED