EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Breaking Bones, Breaking Barriers: ChatGPT, DeepSeek, and Gemini in Hand Fracture Management

Gianluca Marcaccini iD, Ishith Seth iD, Yi Xie, Pietro Susini iD, Mirco Pozzi iD, Roberto Cuomo iD, Warren M Rozen iD

Journal of Clinical Medicine · 14.03.2025 · 14 (6) · 1983

DOI: 10.3390/jcm14061983 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Clinical Medicine, online erschienen am 14.03.2025. Verfasst von Gianluca Marcaccini und 6 weiteren Autor:innen. Beteiligte Einrichtung: Plastic Surgery Unit, Department of Medicine, Surgery and Neuroscience, University of Siena, 53100 Siena, Italy. Die Arbeit wurde bisher 51-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Hand fracture management requires precise diagnostic accuracy and complex decision-making. Advances in artificial intelligence (AI) suggest that large language models (LLMs) may assist or even rival traditional clinical approaches. This study evaluates the effectiveness of ChatGPT-4o, DeepSeek-V3, and Gemini 1.5 in diagnosing and recommending treatment strategies for hand fractures compared to experienced surgeons.

Methods

A retrospective analysis of 58 anonymized hand fracture cases was conducted. Clinical details, including fracture site, displacement, and soft-tissue involvement, were provided to the AI models, which generated management plans. Their recommendations were compared to actual surgeon decisions, assessing accuracy, precision, recall, and F1 score.

Results

ChatGPT-4o demonstrated the highest accuracy (98.28%) and recall (91.74%), effectively identifying most correct interventions but occasionally proposing extraneous options (precision 58.48%). DeepSeek-V3 showed moderate accuracy (63.79%), with balanced precision (61.17%) and recall (57.89%), sometimes omitting correct treatments. Gemini 1.5 performed poorly (accuracy 18.97%), with low precision and recall, indicating substantial limitations in clinical decision support.

Conclusions

AI models can enhance clinical workflows, particularly in radiographic interpretation and triage, but their limitations highlight the irreplaceable role of human expertise in complex hand trauma management. ChatGPT-4o demonstrated promising accuracy but requires refinement. Ethical concerns regarding AI-driven medical decisions, including bias and transparency, must be addressed before widespread clinical implementation.

Schlagwörter

Stichwörter der Autor:innen

ChatGPT-4oDeepSeek-V3Gemini 1.5artificial intelligencehand fractureslarge language modelssurgical decision-making

Autor:innen und Institutionen

  • Plastic Surgery Unit, Department of Medicine, Surgery and Neuroscience, University of Siena, 53100 Siena, Italy.
  • Department of Plastic and Reconstructive Surgery, Peninsula Health, Frankston, VIC 3199, Australia.

ORCID-Profile: Gianluca Marcaccini, Ishith Seth, Pietro Susini, Mirco Pozzi, Roberto Cuomo, Warren M Rozen

Zitieren

APA

Marcaccini, G., Seth, I., Xie, Y., Susini, P., Pozzi, M., Cuomo, R., & Rozen, W. M. (2025). Breaking Bones, Breaking Barriers: ChatGPT, DeepSeek, and Gemini in Hand Fracture Management. Journal of Clinical Medicine, 14(6), 1983. https://doi.org/10.3390/jcm14061983

Vancouver

Marcaccini G, Seth I, Xie Y, Susini P, Pozzi M, Cuomo R, et al. Breaking Bones, Breaking Barriers: ChatGPT, DeepSeek, and Gemini in Hand Fracture Management. Journal of Clinical Medicine. 2025;14(6):1983. doi:10.3390/jcm14061983

BibTeX
@article{Marcaccini2025,
  author = {Marcaccini, Gianluca and Seth, Ishith and Xie, Yi and Susini, Pietro and Pozzi, Mirco and Cuomo, Roberto and Rozen, Warren M},
  title = {Breaking Bones, Breaking Barriers: ChatGPT, DeepSeek, and Gemini in Hand Fracture Management},
  journal = {Journal of Clinical Medicine},
  year = {2025},
  volume = {14},
  number = {6},
  pages = {1983},
  doi = {10.3390/jcm14061983}
}
Kostenlos starten →