Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini
Acta Orthopaedica et Traumatologica Turcica · 18.07.2025 · 59 (4) · 222-229
DOI: 10.5152/j.aott.2025.25279 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Acta Orthopaedica et Traumatologica Turcica, online erschienen am 18.07.2025. Verfasst von Semih Yaş und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthopaedics and Traumatology, Turkish Ministry of Health, Dr. Abdurrahman Yurtaslan Ankara Oncology Training and Research Hospital, An…. Hauptthemen laut MEDLINE: Scoliosis. Die Arbeit wurde bisher 10-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Objective
To evaluate the accuracy, applicability, comprehensiveness, and communication quality of responses generated by ChatGPT and Google Gemini in adolescent idiopathic scoliosis (AIS)-related scenarios, with the aim of assessing their potential utility as tools in patient management.
Methods
Six case-based questions reflecting common patient concerns related to adolescent idiopathic scoliosis were developed byorthopedic specialists. Responses generated by ChatGPT and Google Gemini were independently evaluated by 61 orthopedic surgeons using a standardized rubric assessing accuracy, applicability, comprehensiveness, and communication clarity, each rated on a 1-5 Likert scale. Comparative analyses between platforms were performed using the Mann-Whitney U and Wilcoxon signed-rank tests. Additionally, open-ended feedback was collected to explore participants’ perspectives on the potential and limitations of AI-based consultations.
Results
ChatGPT outperformed Google Gemini in terms of accuracy (P=.013) in postoperative care scenarios. The results for applicability (P=.119), comprehensiveness (P=.619), and communication (P=.240) were not statistically significant. Orthopedic specialists rated both AI models significantly higher than residents in accuracy, applicability, and comprehensiveness. Most evaluators acknowledged the potential of AI to reduce physician workload and support patient guidance; however, concerns were raised regarding reliability, ethical mplications, and the current limitations of AI in ensuring patient safety.
Conclusion
ChatGPT and Google Gemini demonstrated moderate accuracy and communication quality in adolescent idiopathic scoliosis–related scenarios, with ChatGPT showing a modest advantage. Although both models show promising results as supportive tools for patient education and preliminary consultations, their current limitations in accuracy and comprehensiveness restrict their clinical reliability. Multidisciplinary collaboration is crucial to ensure e!ective applications of AI in orthopedic practice. Cite this article as: Yaş S, Yapar D, Yapar A, et al. Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini. Acta Orthop Traumatol Turc., 2025;59(4):222-229.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Orthopaedics and Traumatology, Turkish Ministry of Health, Dr. Abdurrahman Yurtaslan Ankara Oncology Training and Research Hospital, Ankara, Türkiye.
- Department of Public Health, Turkish Ministry of Health, Muratpasa District Health Directorate, Antalya, Türkiye.
- Department of Orthopaedics and Traumatology, Antalya Training and Research Hospital, Antalya, Türkiye.
- Department of Orthopaedics and Traumatology, Ankara Training and Research Hospital, Ankara, Türkiye.
- Department of Orthopaedics and Traumatology, Gazi University Faculty of Medicine, Ankara, Türkiye.
ORCID-Profile: Semih Yaş, Dilek Yapar, Aliekber Yapar, Tayfun Özel, Mehmet Ali Tokgöz, Alim Can Baymurat, Alpaslan Şenköylü
Zitieren
APA
Yaş, S., Yapar, D., Yapar, A., Özel, T., Tokgöz, M. A., Baymurat, A. C., & Şenköylü, A. (2025). Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini. Acta Orthopaedica et Traumatologica Turcica, 59(4), 222-229. https://doi.org/10.5152/j.aott.2025.25279
Vancouver
Yaş S, Yapar D, Yapar A, Özel T, Tokgöz MA, Baymurat AC, et al. Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini. Acta Orthopaedica et Traumatologica Turcica. 2025;59(4):222-229. doi:10.5152/j.aott.2025.25279
BibTeX
@article{Ya2025,
author = {Yaş, Semih and Yapar, Dilek and Yapar, Aliekber and Özel, Tayfun and Tokgöz, Mehmet Ali and Baymurat, Alim Can and Şenköylü, Alpaslan},
title = {Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini},
journal = {Acta Orthopaedica et Traumatologica Turcica},
year = {2025},
volume = {59},
number = {4},
pages = {222--229},
doi = {10.5152/j.aott.2025.25279}
}
EUVIMED