Breaking Bones, Breaking Barriers: ChatGPT, DeepSeek, and Gemini in Hand Fracture Management
Journal of Clinical Medicine · 14.03.2025 · 14 (6) · 1983
DOI: 10.3390/jcm14061983 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 14.03.2025. Verfasst von Gianluca Marcaccini und 6 weiteren Autor:innen. Beteiligte Einrichtung: Plastic Surgery Unit, Department of Medicine, Surgery and Neuroscience, University of Siena, 53100 Siena, Italy. Die Arbeit wurde bisher 51-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Hand fracture management requires precise diagnostic accuracy and complex decision-making. Advances in artificial intelligence (AI) suggest that large language models (LLMs) may assist or even rival traditional clinical approaches. This study evaluates the effectiveness of ChatGPT-4o, DeepSeek-V3, and Gemini 1.5 in diagnosing and recommending treatment strategies for hand fractures compared to experienced surgeons.
Methods
A retrospective analysis of 58 anonymized hand fracture cases was conducted. Clinical details, including fracture site, displacement, and soft-tissue involvement, were provided to the AI models, which generated management plans. Their recommendations were compared to actual surgeon decisions, assessing accuracy, precision, recall, and F1 score.
Results
ChatGPT-4o demonstrated the highest accuracy (98.28%) and recall (91.74%), effectively identifying most correct interventions but occasionally proposing extraneous options (precision 58.48%). DeepSeek-V3 showed moderate accuracy (63.79%), with balanced precision (61.17%) and recall (57.89%), sometimes omitting correct treatments. Gemini 1.5 performed poorly (accuracy 18.97%), with low precision and recall, indicating substantial limitations in clinical decision support.
Conclusions
AI models can enhance clinical workflows, particularly in radiographic interpretation and triage, but their limitations highlight the irreplaceable role of human expertise in complex hand trauma management. ChatGPT-4o demonstrated promising accuracy but requires refinement. Ethical concerns regarding AI-driven medical decisions, including bias and transparency, must be addressed before widespread clinical implementation.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Plastic Surgery Unit, Department of Medicine, Surgery and Neuroscience, University of Siena, 53100 Siena, Italy.
- Department of Plastic and Reconstructive Surgery, Peninsula Health, Frankston, VIC 3199, Australia.
ORCID-Profile: Gianluca Marcaccini, Ishith Seth, Pietro Susini, Mirco Pozzi, Roberto Cuomo, Warren M Rozen
Zitieren
APA
Marcaccini, G., Seth, I., Xie, Y., Susini, P., Pozzi, M., Cuomo, R., & Rozen, W. M. (2025). Breaking Bones, Breaking Barriers: ChatGPT, DeepSeek, and Gemini in Hand Fracture Management. Journal of Clinical Medicine, 14(6), 1983. https://doi.org/10.3390/jcm14061983
Vancouver
Marcaccini G, Seth I, Xie Y, Susini P, Pozzi M, Cuomo R, et al. Breaking Bones, Breaking Barriers: ChatGPT, DeepSeek, and Gemini in Hand Fracture Management. Journal of Clinical Medicine. 2025;14(6):1983. doi:10.3390/jcm14061983
BibTeX
@article{Marcaccini2025,
author = {Marcaccini, Gianluca and Seth, Ishith and Xie, Yi and Susini, Pietro and Pozzi, Mirco and Cuomo, Roberto and Rozen, Warren M},
title = {Breaking Bones, Breaking Barriers: ChatGPT, DeepSeek, and Gemini in Hand Fracture Management},
journal = {Journal of Clinical Medicine},
year = {2025},
volume = {14},
number = {6},
pages = {1983},
doi = {10.3390/jcm14061983}
}
EUVIMED