EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Can AI-Based ChatGPT Models Accurately Analyze Hand–Wrist Radiographs? A Comparative Study

Ahmet Yıldırım iD, Orhan Cicek iD, Yavuz Selim Genç iD

Diagnostics · 14.06.2025 · 15 (12) · 1513

DOI: 10.3390/diagnostics15121513 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Diagnostics, online erschienen am 14.06.2025. Verfasst von Ahmet Yıldırım und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthodontics, Faculty of Dentistry, Zonguldak Bulent Ecevit University, Zonguldak 67600, Türkiye. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background/Aims: The aim of this study was to evaluate the effectiveness of large language model (LLM)-based chatbot systems in predicting bone age and identifying growth stages, and to explore their potential as practical, infrastructure-independent alternatives to conventional methods and convolutional neural network (CNN)-based deep learning models.

Methods

This study evaluated the performance of three ChatGPT-based models (GPT-4o, GPT-o4-mini-high, and GPT-o1-pro) in predicting bone age and growth stage using 90 anonymized hand–wrist radiographs (30 from each growth stage—pre-peak, peak, and post-peak—with equal male and female distribution). Reference standards were ensured by expert orthodontists using Fishman’s Skeletal Maturity Indicators (SMI) system and the Greulich–Pyle Atlas, with each radiograph analyzed by three GPT models using standardized prompts. Model performances were evaluated through statistical analyses assessing agreement and prediction accuracy.

Results

All models showed significant agreement with the reference values in bone age prediction (p < 0.001), with GPT-o1-pro having the highest concordance (Pearson r = 0.546). No statistically significant difference was observed in the mean absolute error (MAE) among the models (p > 0.05). The GPT-o4-mini-high model achieved an accuracy rate of 72.2% within a ±2 year deviation range for bone age prediction. The GPT-o1-pro and GPT-o4-mini-high models showed bias in the Bland–Altman analysis of bone age predictions; however, GPT-o1-pro yielded more reliable predictions with narrower limits of agreement. In terms of growth stage classification, the GPT-4o model achieved the highest agreement with the reference values (κ = 0.283, p < 0.001).

Conclusions

This study shows that general-purpose GPT models can support bone age and growth stages prediction, with each model having distinct strengths. While GPT models do not replace clinical examination, their contextual reasoning and ability to perform preliminary assessments without domain-specific training make them promising tools, though further development is needed.

Schlagwörter

Stichwörter der Autor:innen

ChatGPTartificial intelligencebone ageconvolutional neural networkdeep learninggrowth stagelarge language models

Autor:innen und Institutionen

  • Department of Orthodontics, Faculty of Dentistry, Zonguldak Bulent Ecevit University, Zonguldak 67600, Türkiye.
  • Samsun Oral and Dental Health Hospital, Samsun Provincial Health Directorate, Samsun 55060, Türkiye.

ORCID-Profile: Ahmet Yıldırım, Orhan Cicek, Yavuz Selim Genç

Zitieren

APA

Yıldırım, A., Cicek, O., & Genç, Y. S. (2025). Can AI-Based ChatGPT Models Accurately Analyze Hand–Wrist Radiographs? A Comparative Study. Diagnostics, 15(12), 1513. https://doi.org/10.3390/diagnostics15121513

Vancouver

Yıldırım A, Cicek O, Genç YS. Can AI-Based ChatGPT Models Accurately Analyze Hand–Wrist Radiographs? A Comparative Study. Diagnostics. 2025;15(12):1513. doi:10.3390/diagnostics15121513

BibTeX
@article{Yldrm2025,
  author = {Yıldırım, Ahmet and Cicek, Orhan and Genç, Yavuz Selim},
  title = {Can AI-Based ChatGPT Models Accurately Analyze Hand–Wrist Radiographs? A Comparative Study},
  journal = {Diagnostics},
  year = {2025},
  volume = {15},
  number = {12},
  pages = {1513},
  doi = {10.3390/diagnostics15121513}
}
Kostenlos starten →