EUVIMEDEUVIMED entdecken
BeobachtungsstudieLeitlinie

Can Artificial Intelligence Align with Evidence? Performance of ChatGPT-4o in Knee Osteoarthritis Surgical Guidelines

Fernando García-Sanz, María Bravo-Aguilar, Lorena Canosa-Carro, María Blanco-Morales, Carlos Romero-Morales iD, Ángel González-de-la-Flor

The Journal of Knee Surgery · 01.09.2026 · 39 (11) · 575-580

DOI: 10.1055/a-2802-2998 ↗

Kurz gefasst

Beobachtungsstudie in der Zeitschrift The Journal of Knee Surgery, erschienen am 01.09.2026. Verfasst von Fernando García-Sanz und 5 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Medicine, Health and Sport, Universidad Europea de Madrid, Villaviciosa de Odón, Madrid, Spain. Hauptthemen laut MEDLINE: Arthroplasty, Replacement, Knee, Generative Artificial Intelligence, Osteoarthritis, Knee, Practice Guidelines as Topic. Die Arbeit nennt 24 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Artificial intelligence large language models (LLMs) such as ChatGPT are increasingly used in clinical settings, yet their reliability in reproducing evidence-based recommendations remains uncertain. This study aimed to evaluate the performance of ChatGPT-4o in addressing clinical practice guideline (CPG) recommendations for the surgical management of knee osteoarthritis and total knee arthroplasty (TKA). An observational cross-sectional design was conducted in September 2025. Twenty recommendations from the most recent American Academy of Orthopaedic Surgeons CPG on TKA were translated into structured clinical questions and submitted to ChatGPT-4o. Each query was entered three times in independent sessions to evaluate textual consistency. Two independent reviewers with expertise in musculoskeletal physiotherapy and orthopedics appraised the chatbot's answers, classifying them according to the CPG framework (“should do,” “could do,” “do not do,” “uncertain”). Agreement between reviewers and alignment with CPG recommendations were assessed using Cohen's and Fleiss' Kappa coefficients. ChatGPT-4o achieved an overall concordance of 60% with the CPG recommendations, representing fair agreement (κ = 0.392, p = 0.005). Internal text consistency across repeated trials was low, with several responses showing unacceptable similarity levels (

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Arthroplasty, Replacement, KneeGenerative Artificial IntelligenceOsteoarthritis, KneePractice Guidelines as TopicHumansCross-Sectional StudiesEvidence-Based MedicineLarge Language ModelsReproducibility of Results

Autor:innen und Institutionen

  • Faculty of Medicine, Health and Sport, Universidad Europea de Madrid, Villaviciosa de Odón, Madrid, Spain.
  • Clínica CEMTRO, Madrid, Spain.

ORCID-Profile: Carlos Romero-Morales

Zitieren

APA

García-Sanz, F., Bravo-Aguilar, M., Canosa-Carro, L., Blanco-Morales, M., Romero-Morales, C., & González-de-la-Flor, Á. (2026). Can Artificial Intelligence Align with Evidence? Performance of ChatGPT-4o in Knee Osteoarthritis Surgical Guidelines. The Journal of Knee Surgery, 39(11), 575-580. https://doi.org/10.1055/a-2802-2998

Vancouver

García-Sanz F, Bravo-Aguilar M, Canosa-Carro L, Blanco-Morales M, Romero-Morales C, González-de-la-Flor Á. Can Artificial Intelligence Align with Evidence? Performance of ChatGPT-4o in Knee Osteoarthritis Surgical Guidelines. The Journal of Knee Surgery. 2026;39(11):575-580. doi:10.1055/a-2802-2998

BibTeX
@article{GarcaSanz2026,
  author = {García-Sanz, Fernando and Bravo-Aguilar, María and Canosa-Carro, Lorena and Blanco-Morales, María and Romero-Morales, Carlos and González-de-la-Flor, Ángel},
  title = {Can Artificial Intelligence Align with Evidence? Performance of ChatGPT-4o in Knee Osteoarthritis Surgical Guidelines},
  journal = {The Journal of Knee Surgery},
  year = {2026},
  volume = {39},
  number = {11},
  pages = {575--580},
  doi = {10.1055/a-2802-2998}
}
Kostenlos starten →