Can Artificial Intelligence Align with Evidence? Performance of ChatGPT-4o in Knee Osteoarthritis Surgical Guidelines
The Journal of Knee Surgery · 01.09.2026 · 39 (11) · 575-580
DOI: 10.1055/a-2802-2998 ↗Kurz gefasst
Beobachtungsstudie in der Zeitschrift The Journal of Knee Surgery, erschienen am 01.09.2026. Verfasst von Fernando García-Sanz und 5 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Medicine, Health and Sport, Universidad Europea de Madrid, Villaviciosa de Odón, Madrid, Spain. Hauptthemen laut MEDLINE: Arthroplasty, Replacement, Knee, Generative Artificial Intelligence, Osteoarthritis, Knee, Practice Guidelines as Topic. Die Arbeit nennt 24 Literaturangaben.
Abstract (Originalsprache)
Artificial intelligence large language models (LLMs) such as ChatGPT are increasingly used in clinical settings, yet their reliability in reproducing evidence-based recommendations remains uncertain. This study aimed to evaluate the performance of ChatGPT-4o in addressing clinical practice guideline (CPG) recommendations for the surgical management of knee osteoarthritis and total knee arthroplasty (TKA). An observational cross-sectional design was conducted in September 2025. Twenty recommendations from the most recent American Academy of Orthopaedic Surgeons CPG on TKA were translated into structured clinical questions and submitted to ChatGPT-4o. Each query was entered three times in independent sessions to evaluate textual consistency. Two independent reviewers with expertise in musculoskeletal physiotherapy and orthopedics appraised the chatbot's answers, classifying them according to the CPG framework (“should do,” “could do,” “do not do,” “uncertain”). Agreement between reviewers and alignment with CPG recommendations were assessed using Cohen's and Fleiss' Kappa coefficients. ChatGPT-4o achieved an overall concordance of 60% with the CPG recommendations, representing fair agreement (κ = 0.392, p = 0.005). Internal text consistency across repeated trials was low, with several responses showing unacceptable similarity levels (
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Faculty of Medicine, Health and Sport, Universidad Europea de Madrid, Villaviciosa de Odón, Madrid, Spain.
- Clínica CEMTRO, Madrid, Spain.
ORCID-Profile: Carlos Romero-Morales
Zitieren
APA
García-Sanz, F., Bravo-Aguilar, M., Canosa-Carro, L., Blanco-Morales, M., Romero-Morales, C., & González-de-la-Flor, Á. (2026). Can Artificial Intelligence Align with Evidence? Performance of ChatGPT-4o in Knee Osteoarthritis Surgical Guidelines. The Journal of Knee Surgery, 39(11), 575-580. https://doi.org/10.1055/a-2802-2998
Vancouver
García-Sanz F, Bravo-Aguilar M, Canosa-Carro L, Blanco-Morales M, Romero-Morales C, González-de-la-Flor Á. Can Artificial Intelligence Align with Evidence? Performance of ChatGPT-4o in Knee Osteoarthritis Surgical Guidelines. The Journal of Knee Surgery. 2026;39(11):575-580. doi:10.1055/a-2802-2998
BibTeX
@article{GarcaSanz2026,
author = {García-Sanz, Fernando and Bravo-Aguilar, María and Canosa-Carro, Lorena and Blanco-Morales, María and Romero-Morales, Carlos and González-de-la-Flor, Ángel},
title = {Can Artificial Intelligence Align with Evidence? Performance of ChatGPT-4o in Knee Osteoarthritis Surgical Guidelines},
journal = {The Journal of Knee Surgery},
year = {2026},
volume = {39},
number = {11},
pages = {575--580},
doi = {10.1055/a-2802-2998}
}
EUVIMED