Accuracy and readability analysis of ChatGPT responses to frequently asked questions about olecranon fractures
Journal of Orthopaedic Surgery · 2026-05 · 34 (2)
DOI: 10.1177/10225536261469293 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Orthopaedic Surgery, online erschienen am 11.07.2026. Verfasst von İbrahim Halil Dadir. Beteiligte Einrichtung: Department of Orthopaedics and Traumatology, Van Training and Research Hospital, Van, Turkey. Hauptthemen laut MEDLINE: Comprehension, Olecranon Fracture. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Purpose
This study aimed to evaluate the reliability, quality, and readability of ChatGPT-generated responses to common patient questions about olecranon fractures.
Methods
In this cross-sectional study, twenty frequently asked questions were identified using Google’s “People also ask” feature and submitted to ChatGPT-4o in separate sessions between October 1 and October 10, 2025. Two orthopaedic surgeons independently assessed the responses using the DISCERN instrument and Global Quality Score (GQS). Readability was analysed using Flesch Reading Ease (FRE), Flesch–Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Gunning Fog Index (GFI).
Results
Mean DISCERN and GQS scores (51.25 ± 4.13 and 4.10 ± 0.58) indicated good quality and reliability. The mean FRE was 62.00 ± 5.12, and mean FKGL, SMOG, and GFI values (9.23, 8.42, 9.37) corresponded to a ninth-grade reading level. DISCERN and GQS were strongly correlated (r = 0.913, p < 0.001) and negatively associated with FKGL.
Conclusion
ChatGPT-4o produced coherent responses of generally good quality and reliability regarding olecranon fractures; however, readability levels exceeded those recommended for patient comprehension. These findings suggest that while ChatGPT may serve as a supportive informational tool, clinician guidance remains essential to ensure appropriate patient understanding and prevent potential misinformation.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Orthopaedics and Traumatology, Van Training and Research Hospital, Van, Turkey.
ORCID-Profile: İbrahim Halil Dadir
Zitieren
APA
Dadir, İ. H. (2026). Accuracy and readability analysis of ChatGPT responses to frequently asked questions about olecranon fractures. Journal of Orthopaedic Surgery, 34(2). https://doi.org/10.1177/10225536261469293
Vancouver
Dadir İH. Accuracy and readability analysis of ChatGPT responses to frequently asked questions about olecranon fractures. Journal of Orthopaedic Surgery. 2026;34(2). doi:10.1177/10225536261469293
BibTeX
@article{Dadir2026,
author = {Dadir, İbrahim Halil},
title = {Accuracy and readability analysis of ChatGPT responses to frequently asked questions about olecranon fractures},
journal = {Journal of Orthopaedic Surgery},
year = {2026},
volume = {34},
number = {2},
doi = {10.1177/10225536261469293}
}
EUVIMED