EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Accuracy and readability analysis of ChatGPT responses to frequently asked questions about olecranon fractures

İbrahim Halil Dadir iD

Journal of Orthopaedic Surgery · 2026-05 · 34 (2)

DOI: 10.1177/10225536261469293 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Orthopaedic Surgery, online erschienen am 11.07.2026. Verfasst von İbrahim Halil Dadir. Beteiligte Einrichtung: Department of Orthopaedics and Traumatology, Van Training and Research Hospital, Van, Turkey. Hauptthemen laut MEDLINE: Comprehension, Olecranon Fracture. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

This study aimed to evaluate the reliability, quality, and readability of ChatGPT-generated responses to common patient questions about olecranon fractures.

Methods

In this cross-sectional study, twenty frequently asked questions were identified using Google’s “People also ask” feature and submitted to ChatGPT-4o in separate sessions between October 1 and October 10, 2025. Two orthopaedic surgeons independently assessed the responses using the DISCERN instrument and Global Quality Score (GQS). Readability was analysed using Flesch Reading Ease (FRE), Flesch–Kincaid Grade Level (FKGL), Simple Measure of Gobbledygook (SMOG), and Gunning Fog Index (GFI).

Results

Mean DISCERN and GQS scores (51.25 ± 4.13 and 4.10 ± 0.58) indicated good quality and reliability. The mean FRE was 62.00 ± 5.12, and mean FKGL, SMOG, and GFI values (9.23, 8.42, 9.37) corresponded to a ninth-grade reading level. DISCERN and GQS were strongly correlated (r = 0.913, p < 0.001) and negatively associated with FKGL.

Conclusion

ChatGPT-4o produced coherent responses of generally good quality and reliability regarding olecranon fractures; however, readability levels exceeded those recommended for patient comprehension. These findings suggest that while ChatGPT may serve as a supportive informational tool, clinician guidance remains essential to ensure appropriate patient understanding and prevent potential misinformation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ComprehensionOlecranon FractureHumansCross-Sectional StudiesReproducibility of ResultsGenerative Artificial IntelligenceSurveys and QuestionnairesLarge Language Models

Stichwörter der Autor:innen

Artificial Intelligencebonefracturesolecranon processquality controlreadabilityreproducibility of results

Autor:innen und Institutionen

  • Department of Orthopaedics and Traumatology, Van Training and Research Hospital, Van, Turkey.

ORCID-Profile: İbrahim Halil Dadir

Zitieren

APA

Dadir, İ. H. (2026). Accuracy and readability analysis of ChatGPT responses to frequently asked questions about olecranon fractures. Journal of Orthopaedic Surgery, 34(2). https://doi.org/10.1177/10225536261469293

Vancouver

Dadir İH. Accuracy and readability analysis of ChatGPT responses to frequently asked questions about olecranon fractures. Journal of Orthopaedic Surgery. 2026;34(2). doi:10.1177/10225536261469293

BibTeX
@article{Dadir2026,
  author = {Dadir, İbrahim Halil},
  title = {Accuracy and readability analysis of ChatGPT responses to frequently asked questions about olecranon fractures},
  journal = {Journal of Orthopaedic Surgery},
  year = {2026},
  volume = {34},
  number = {2},
  doi = {10.1177/10225536261469293}
}
Kostenlos starten →