Can AI-Based ChatGPT Models Accurately Analyze Hand–Wrist Radiographs? A Comparative Study
Diagnostics · 14.06.2025 · 15 (12) · 1513
DOI: 10.3390/diagnostics15121513 ↗Kurz gefasst
Fachartikel in der Zeitschrift Diagnostics, online erschienen am 14.06.2025. Verfasst von Ahmet Yıldırım und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthodontics, Faculty of Dentistry, Zonguldak Bulent Ecevit University, Zonguldak 67600, Türkiye. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background/Aims: The aim of this study was to evaluate the effectiveness of large language model (LLM)-based chatbot systems in predicting bone age and identifying growth stages, and to explore their potential as practical, infrastructure-independent alternatives to conventional methods and convolutional neural network (CNN)-based deep learning models.
Methods
This study evaluated the performance of three ChatGPT-based models (GPT-4o, GPT-o4-mini-high, and GPT-o1-pro) in predicting bone age and growth stage using 90 anonymized hand–wrist radiographs (30 from each growth stage—pre-peak, peak, and post-peak—with equal male and female distribution). Reference standards were ensured by expert orthodontists using Fishman’s Skeletal Maturity Indicators (SMI) system and the Greulich–Pyle Atlas, with each radiograph analyzed by three GPT models using standardized prompts. Model performances were evaluated through statistical analyses assessing agreement and prediction accuracy.
Results
All models showed significant agreement with the reference values in bone age prediction (p < 0.001), with GPT-o1-pro having the highest concordance (Pearson r = 0.546). No statistically significant difference was observed in the mean absolute error (MAE) among the models (p > 0.05). The GPT-o4-mini-high model achieved an accuracy rate of 72.2% within a ±2 year deviation range for bone age prediction. The GPT-o1-pro and GPT-o4-mini-high models showed bias in the Bland–Altman analysis of bone age predictions; however, GPT-o1-pro yielded more reliable predictions with narrower limits of agreement. In terms of growth stage classification, the GPT-4o model achieved the highest agreement with the reference values (κ = 0.283, p < 0.001).
Conclusions
This study shows that general-purpose GPT models can support bone age and growth stages prediction, with each model having distinct strengths. While GPT models do not replace clinical examination, their contextual reasoning and ability to perform preliminary assessments without domain-specific training make them promising tools, though further development is needed.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Orthodontics, Faculty of Dentistry, Zonguldak Bulent Ecevit University, Zonguldak 67600, Türkiye.
- Samsun Oral and Dental Health Hospital, Samsun Provincial Health Directorate, Samsun 55060, Türkiye.
ORCID-Profile: Ahmet Yıldırım, Orhan Cicek, Yavuz Selim Genç
Zitieren
APA
Yıldırım, A., Cicek, O., & Genç, Y. S. (2025). Can AI-Based ChatGPT Models Accurately Analyze Hand–Wrist Radiographs? A Comparative Study. Diagnostics, 15(12), 1513. https://doi.org/10.3390/diagnostics15121513
Vancouver
Yıldırım A, Cicek O, Genç YS. Can AI-Based ChatGPT Models Accurately Analyze Hand–Wrist Radiographs? A Comparative Study. Diagnostics. 2025;15(12):1513. doi:10.3390/diagnostics15121513
BibTeX
@article{Yldrm2025,
author = {Yıldırım, Ahmet and Cicek, Orhan and Genç, Yavuz Selim},
title = {Can AI-Based ChatGPT Models Accurately Analyze Hand–Wrist Radiographs? A Comparative Study},
journal = {Diagnostics},
year = {2025},
volume = {15},
number = {12},
pages = {1513},
doi = {10.3390/diagnostics15121513}
}
EUVIMED