EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Expert evaluation of ChatGPT-generated responses to patient questions in conventional and fast-track total knee arthroplasty

Bartosz Maciag, Dawid Jegierski, Andrzej Frankiewicz, Piotr Tarkowski, Krystian Żarnovsky, Filip Mietlicki, Artur Stolarczyk

Archives of Orthopaedic and Trauma Surgery · 2026

DOI: 10.1007/s00402-026-06534-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Archives of Orthopaedic and Trauma Surgery, 2026. Verfasst von Bartosz Maciag und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthopaedics and Rehabilitation, Medical University of Warsaw, Warsaw, Poland. Hauptthemen laut MEDLINE: Arthroplasty, Replacement, Knee, Patient Education as Topic. Die Arbeit nennt 12 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Fast-track total knee arthroplasty (TKA) asks patients to understand early mobilization, early discharge, opioid-sparing analgesia, and selective use of drains and catheters. We evaluated expert-rated quality of ChatGPT responses to patient questions about these pathway-specific concepts alongside conventional TKA questions. Materials and methods In this cross-sectional evaluation, three arthroplasty surgeons independently scored responses to 50 conventional TKA and 20 investigator-developed fast-track questions in four domains on 5-point scales. The conventional questions were selected by a multidisciplinary panel; the fast-track questions did not undergo the same selection process. Response-level means were compared descriptively and with exploratory Mann-Whitney U tests.

Results

Seventy responses received 210 expert assessments. Recalculated mean ± SD scores across individual ratings were 4.99 ± 0.15 for accuracy, 4.98 ± 0.14 for completeness, 4.98 ± 0.17 for safety, and 5.00 ± 0.07 for readability. Each of the 20 fast-track responses received a score of 5 from each of the three raters in all four domains (Supplementary Table S1). Nevertheless, question-set construction differed and scores clustered at the ceiling, so the exploratory comparison does not establish equivalence.

Conclusions

Experts gave high ratings to the evaluated responses, including those on fast-track concepts. The observed data do not establish equivalence between question sets: the fast-track ratings require source-data verification, the sets were selected differently, and scores were concentrated at the maximum. Clinician review remains appropriate for protocol-dependent and safety-related advice.

Trial registration

Not applicable.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Arthroplasty, Replacement, KneePatient Education as TopicHumansCross-Sectional StudiesGenerative Artificial IntelligenceSurveys and Questionnaires

Stichwörter der Autor:innen

ArthroplastyChatGPTERASFast-trackTKA

Autor:innen und Institutionen

  • Department of Orthopaedics and Rehabilitation, Medical University of Warsaw, Warsaw, Poland.
  • Department of Orthopaedics and Rehabilitation, Medical University of Warsaw, Warsaw, Poland. jegierski.dawid@gmail.com.
  • Comprehensive Rehabilitation Center, Konstancin-Jeziorna, Poland.

Zitieren

APA

Maciag, B., Jegierski, D., Frankiewicz, A., Tarkowski, P., Żarnovsky, K., Mietlicki, F., & Stolarczyk, A. (2026). Expert evaluation of ChatGPT-generated responses to patient questions in conventional and fast-track total knee arthroplasty. Archives of Orthopaedic and Trauma Surgery. https://doi.org/10.1007/s00402-026-06534-7

Vancouver

Maciag B, Jegierski D, Frankiewicz A, Tarkowski P, Żarnovsky K, Mietlicki F, et al. Expert evaluation of ChatGPT-generated responses to patient questions in conventional and fast-track total knee arthroplasty. Archives of Orthopaedic and Trauma Surgery. 2026. doi:10.1007/s00402-026-06534-7

BibTeX
@article{Maciag2026,
  author = {Maciag, Bartosz and Jegierski, Dawid and Frankiewicz, Andrzej and Tarkowski, Piotr and Żarnovsky, Krystian and Mietlicki, Filip and Stolarczyk, Artur},
  title = {Expert evaluation of ChatGPT-generated responses to patient questions in conventional and fast-track total knee arthroplasty},
  journal = {Archives of Orthopaedic and Trauma Surgery},
  year = {2026},
  doi = {10.1007/s00402-026-06534-7}
}
Kostenlos starten →