EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY-NC 4.0

Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini

Semih Yaş iD, Dilek Yapar iD, Aliekber Yapar iD, Tayfun Özel iD, Mehmet Ali Tokgöz iD, Alim Can Baymurat iD, Alpaslan Şenköylü iD

Acta Orthopaedica et Traumatologica Turcica · 18.07.2025 · 59 (4) · 222-229

DOI: 10.5152/j.aott.2025.25279 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Acta Orthopaedica et Traumatologica Turcica, online erschienen am 18.07.2025. Verfasst von Semih Yaş und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthopaedics and Traumatology, Turkish Ministry of Health, Dr. Abdurrahman Yurtaslan Ankara Oncology Training and Research Hospital, An…. Hauptthemen laut MEDLINE: Scoliosis. Die Arbeit wurde bisher 10-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

To evaluate the accuracy, applicability, comprehensiveness, and communication quality of responses generated by ChatGPT and Google Gemini in adolescent idiopathic scoliosis (AIS)-related scenarios, with the aim of assessing their potential utility as tools in patient management.

Methods

Six case-based questions reflecting common patient concerns related to adolescent idiopathic scoliosis were developed byorthopedic specialists. Responses generated by ChatGPT and Google Gemini were independently evaluated by 61 orthopedic surgeons using a standardized rubric assessing accuracy, applicability, comprehensiveness, and communication clarity, each rated on a 1-5 Likert scale. Comparative analyses between platforms were performed using the Mann-Whitney U and Wilcoxon signed-rank tests. Additionally, open-ended feedback was collected to explore participants’ perspectives on the potential and limitations of AI-based consultations.

Results

ChatGPT outperformed Google Gemini in terms of accuracy (P=.013) in postoperative care scenarios. The results for applicability (P=.119), comprehensiveness (P=.619), and communication (P=.240) were not statistically significant. Orthopedic specialists rated both AI models significantly higher than residents in accuracy, applicability, and comprehensiveness. Most evaluators acknowledged the potential of AI to reduce physician workload and support patient guidance; however, concerns were raised regarding reliability, ethical mplications, and the current limitations of AI in ensuring patient safety.

Conclusion

ChatGPT and Google Gemini demonstrated moderate accuracy and communication quality in adolescent idiopathic scoliosis–related scenarios, with ChatGPT showing a modest advantage. Although both models show promising results as supportive tools for patient education and preliminary consultations, their current limitations in accuracy and comprehensiveness restrict their clinical reliability. Multidisciplinary collaboration is crucial to ensure e!ective applications of AI in orthopedic practice. Cite this article as: Yaş S, Yapar D, Yapar A, et al. Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini. Acta Orthop Traumatol Turc., 2025;59(4):222-229.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ScoliosisHumansAdolescentFemaleMaleCommunicationReproducibility of ResultsLanguageSurveys and QuestionnairesLarge Language ModelsGenerative Artificial Intelligence

Autor:innen und Institutionen

  • Department of Orthopaedics and Traumatology, Turkish Ministry of Health, Dr. Abdurrahman Yurtaslan Ankara Oncology Training and Research Hospital, Ankara, Türkiye.
  • Department of Public Health, Turkish Ministry of Health, Muratpasa District Health Directorate, Antalya, Türkiye.
  • Department of Orthopaedics and Traumatology, Antalya Training and Research Hospital, Antalya, Türkiye.
  • Department of Orthopaedics and Traumatology, Ankara Training and Research Hospital, Ankara, Türkiye.
  • Department of Orthopaedics and Traumatology, Gazi University Faculty of Medicine, Ankara, Türkiye.

ORCID-Profile: Semih Yaş, Dilek Yapar, Aliekber Yapar, Tayfun Özel, Mehmet Ali Tokgöz, Alim Can Baymurat, Alpaslan Şenköylü

Zitieren

APA

Yaş, S., Yapar, D., Yapar, A., Özel, T., Tokgöz, M. A., Baymurat, A. C., & Şenköylü, A. (2025). Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini. Acta Orthopaedica et Traumatologica Turcica, 59(4), 222-229. https://doi.org/10.5152/j.aott.2025.25279

Vancouver

Yaş S, Yapar D, Yapar A, Özel T, Tokgöz MA, Baymurat AC, et al. Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini. Acta Orthopaedica et Traumatologica Turcica. 2025;59(4):222-229. doi:10.5152/j.aott.2025.25279

BibTeX
@article{Ya2025,
  author = {Yaş, Semih and Yapar, Dilek and Yapar, Aliekber and Özel, Tayfun and Tokgöz, Mehmet Ali and Baymurat, Alim Can and Şenköylü, Alpaslan},
  title = {Assessing the role of large language models in adolescent idiopathic scoliosis care: a comparison between ChatGPT and Google Gemini},
  journal = {Acta Orthopaedica et Traumatologica Turcica},
  year = {2025},
  volume = {59},
  number = {4},
  pages = {222--229},
  doi = {10.5152/j.aott.2025.25279}
}
Kostenlos starten →