EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Pandora’s Box of Pediatric Sports Medicine: Assessing ChatGPT Responses to Patient-Centered Questions in Pediatric Sports Medicine

Martha Kebeh, Kevin Landrum, Brendon Mitchell, Akbar Syed, Joseph Yellin, Brendan Williams, Kathleen Maguire, J. Todd Lawrence, Theodore Ganley

Orthopaedic Journal of Sports Medicine · 2026-06 · 14 (6_suppl5)

DOI: 10.1177/2325967126s00174 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Orthopaedic Journal of Sports Medicine, online erschienen am 17.06.2026. Verfasst von Martha Kebeh und 8 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The ubiquitous use of the internet to investigate health concerns and the popularity of Chat Generative Pre-trained Transformer (ChatGPT), the fastest-growing consumer app in history, make it a likely source of information for patients. ChatGPT has provided accurate orthopaedic differential diagnoses and satisfactory responses to patient questions about slipped capital femoral epiphysis and in-toeing, but its performance regarding management and outcomes of pediatric sports diagnoses remains to be seen. The purpose of this study was to assess ChatGPT’s ability to answer pediatric sports medicine questions. Hypothesis: ChatGPT’s responses to pediatric sports medicine questions will be considered generally accurate by orthopaedic experts regardless of question topic or rater experience level. Responses for more frequently asked questions will have better readability and accuracy.

Methods

Five frequently asked questions (FAQ) from patient education webpages and eight complex questions composed from the authors’ clinical experience were selected based on frequency of appearance and importance in patient education and asked of ChatGPT, using a guest internet browser profile without stored history or cookies to limit bias. Four board-certified pediatric orthopaedic surgeons and 2 orthopaedic clinical fellows scored each ChatGPT response on a 0-5 scale in each of three domains: accuracy, relevance and clarity. Flesch-Kincaid Grade Level and Flesch Reading Ease were determined using Microsoft Word. Weighted Cohen kappa and Kendall’s coefficient of concordance (KCC) were used to assess rater agreement. All data were analyzed using Shapiro-Wilk test for normality, Mann Whitney U test, one-way ANOVA, Fisher’s exact test, and Kruskal-Wallis test as appropriate based on normality.

Results

The mean FGKL and median FRE were 15.4±2.2 and 23.6 (13.1-27.8), respectively. With median FRE 3.0 (6.7-19.2), PFI responses demonstrated significantly lower readability than meniscus responses (p=0.032). Agreement among all raters was moderate (KCC, 0.57). When subdivided by experience level, agreement among raters was fair (weighted Cohen kappa coefficient, 0.298). Scores differed significantly by question topic (p

Zitieren

APA

Kebeh, M., Landrum, K., Mitchell, B., Syed, A., Yellin, J., Williams, B., Maguire, K., Lawrence, J. T., & Ganley, T. (2026). Pandora’s Box of Pediatric Sports Medicine: Assessing ChatGPT Responses to Patient-Centered Questions in Pediatric Sports Medicine. Orthopaedic Journal of Sports Medicine, 14(6_suppl5). https://doi.org/10.1177/2325967126s00174

Vancouver

Kebeh M, Landrum K, Mitchell B, Syed A, Yellin J, Williams B, et al. Pandora’s Box of Pediatric Sports Medicine: Assessing ChatGPT Responses to Patient-Centered Questions in Pediatric Sports Medicine. Orthopaedic Journal of Sports Medicine. 2026;14(6_suppl5). doi:10.1177/2325967126s00174

BibTeX
@article{Kebeh2026,
  author = {Kebeh, Martha and Landrum, Kevin and Mitchell, Brendon and Syed, Akbar and Yellin, Joseph and Williams, Brendan and Maguire, Kathleen and Lawrence, J. Todd and Ganley, Theodore},
  title = {Pandora’s Box of Pediatric Sports Medicine: Assessing ChatGPT Responses to Patient-Centered Questions in Pediatric Sports Medicine},
  journal = {Orthopaedic Journal of Sports Medicine},
  year = {2026},
  volume = {14},
  number = {6_suppl5},
  doi = {10.1177/2325967126s00174}
}
Kostenlos starten →