Pandora’s Box of Pediatric Sports Medicine: Assessing ChatGPT Responses to Patient-Centered Questions in Pediatric Sports Medicine
Orthopaedic Journal of Sports Medicine · 2026-06 · 14 (6_suppl5)
DOI: 10.1177/2325967126s00174 ↗Kurz gefasst
Fachartikel in der Zeitschrift Orthopaedic Journal of Sports Medicine, online erschienen am 17.06.2026. Verfasst von Martha Kebeh und 8 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Background
The ubiquitous use of the internet to investigate health concerns and the popularity of Chat Generative Pre-trained Transformer (ChatGPT), the fastest-growing consumer app in history, make it a likely source of information for patients. ChatGPT has provided accurate orthopaedic differential diagnoses and satisfactory responses to patient questions about slipped capital femoral epiphysis and in-toeing, but its performance regarding management and outcomes of pediatric sports diagnoses remains to be seen. The purpose of this study was to assess ChatGPT’s ability to answer pediatric sports medicine questions. Hypothesis: ChatGPT’s responses to pediatric sports medicine questions will be considered generally accurate by orthopaedic experts regardless of question topic or rater experience level. Responses for more frequently asked questions will have better readability and accuracy.
Methods
Five frequently asked questions (FAQ) from patient education webpages and eight complex questions composed from the authors’ clinical experience were selected based on frequency of appearance and importance in patient education and asked of ChatGPT, using a guest internet browser profile without stored history or cookies to limit bias. Four board-certified pediatric orthopaedic surgeons and 2 orthopaedic clinical fellows scored each ChatGPT response on a 0-5 scale in each of three domains: accuracy, relevance and clarity. Flesch-Kincaid Grade Level and Flesch Reading Ease were determined using Microsoft Word. Weighted Cohen kappa and Kendall’s coefficient of concordance (KCC) were used to assess rater agreement. All data were analyzed using Shapiro-Wilk test for normality, Mann Whitney U test, one-way ANOVA, Fisher’s exact test, and Kruskal-Wallis test as appropriate based on normality.
Results
The mean FGKL and median FRE were 15.4±2.2 and 23.6 (13.1-27.8), respectively. With median FRE 3.0 (6.7-19.2), PFI responses demonstrated significantly lower readability than meniscus responses (p=0.032). Agreement among all raters was moderate (KCC, 0.57). When subdivided by experience level, agreement among raters was fair (weighted Cohen kappa coefficient, 0.298). Scores differed significantly by question topic (p
Zitieren
APA
Kebeh, M., Landrum, K., Mitchell, B., Syed, A., Yellin, J., Williams, B., Maguire, K., Lawrence, J. T., & Ganley, T. (2026). Pandora’s Box of Pediatric Sports Medicine: Assessing ChatGPT Responses to Patient-Centered Questions in Pediatric Sports Medicine. Orthopaedic Journal of Sports Medicine, 14(6_suppl5). https://doi.org/10.1177/2325967126s00174
Vancouver
Kebeh M, Landrum K, Mitchell B, Syed A, Yellin J, Williams B, et al. Pandora’s Box of Pediatric Sports Medicine: Assessing ChatGPT Responses to Patient-Centered Questions in Pediatric Sports Medicine. Orthopaedic Journal of Sports Medicine. 2026;14(6_suppl5). doi:10.1177/2325967126s00174
BibTeX
@article{Kebeh2026,
author = {Kebeh, Martha and Landrum, Kevin and Mitchell, Brendon and Syed, Akbar and Yellin, Joseph and Williams, Brendan and Maguire, Kathleen and Lawrence, J. Todd and Ganley, Theodore},
title = {Pandora’s Box of Pediatric Sports Medicine: Assessing ChatGPT Responses to Patient-Centered Questions in Pediatric Sports Medicine},
journal = {Orthopaedic Journal of Sports Medicine},
year = {2026},
volume = {14},
number = {6_suppl5},
doi = {10.1177/2325967126s00174}
}
EUVIMED