EUVIMEDEUVIMED entdecken
Crossref

ChatGPT Provides Unsatisfactory Responses to Frequently Asked Questions Regarding Anterior Cruciate Ligament Reconstruction

William L Johns, Brandon J Martinazzi, Benjamin Miltenberg, Hannah H Nam, Sommer Hammoud

Arthroscopy · 2024-07 · 40 (7) · 2067

DOI: 10.1016/j.arthro.2024.01.017 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Arthroscopy, online erschienen am 02.02.2024. Verfasst von William L Johns und 4 weiteren Autor:innen. Beteiligte Einrichtung: Rothman Orthopaedic Institute, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, U.S.A. Hauptthemen laut MEDLINE: Anterior Cruciate Ligament Reconstruction. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 94 Literaturangaben. Gefördert von: Arthrex, Administration for Community Living.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Purpose

To determine whether the free online artificial intelligence platform ChatGPT could accurately, adequately, and appropriately answer questions regarding anterior cruciate ligament (ACL) reconstruction surgery.

Methods

A list of 10 questions about ACL surgery was created based on a review of frequently asked questions that appeared on websites of various orthopaedic institutions. Each question was separately entered into ChatGPT (version 3.5), and responses were recorded, scored, and graded independently by 3 authors. The reading level of the ChatGPT response was calculated using the WordCalc software package, and readability was assessed using the Flesch‐Kincaid grade level, Simple Measure of Gobbledygook index, Coleman‐Liau index, Gunning fog index, and automated readability index.

Results

Of the 10 frequently asked questions entered into ChatGPT, 6 were deemed as unsatisfactory and requiring substantial clarification; 1, as adequate and requiring moderate clarification; 1, as adequate and requiring minor clarification; and 2, as satisfactory and requiring minimal clarification. The mean DISCERN score was 41 (inter‐rater reliability, 0.721), indicating the responses to the questions were average. According to the readability assessments, a full understanding of the ChatGPT responses required 13.4 years of education, which corresponds to the reading level of a college sophomore.

Conclusions

Most of the ChatGPT‐generated responses were outdated and failed to provide an adequate foundation for patients’ understanding regarding their injury and treatment options. The reading level required to understand the responses was too advanced for some patients, leading to potential misunderstanding and misinterpretation of information. ChatGPT lacks the ability to differentiate and prioritize information that is presented to patients. Clinical Relevance Recognizing the shortcomings in artificial intelligence platforms may equip surgeons to better set expectations and provide support for patients considering and preparing for ACL reconstruction.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Anterior Cruciate Ligament ReconstructionHumansComprehensionArtificial IntelligenceSurveys and QuestionnairesInternet

Autor:innen und Institutionen

  • Rothman Orthopaedic Institute, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, U.S.A.
  • Rothman Orthopaedic Institute, Thomas Jefferson University Hospital, Philadelphia, Pennsylvania, U.S.A.. Electronic address: brandon.martinazzi@rothmanortho.com.
  • Penn State College of Medicine, Hershey, Pennsylvania, U.S.A.

Förderung

  • Arthrex
  • Administration for Community Living

Zitieren

APA

Johns, W. L., Martinazzi, B. J., Miltenberg, B., Nam, H. H., & Hammoud, S. (2024). ChatGPT Provides Unsatisfactory Responses to Frequently Asked Questions Regarding Anterior Cruciate Ligament Reconstruction. Arthroscopy, 40(7), 2067. https://doi.org/10.1016/j.arthro.2024.01.017

Vancouver

Johns WL, Martinazzi BJ, Miltenberg B, Nam HH, Hammoud S. ChatGPT Provides Unsatisfactory Responses to Frequently Asked Questions Regarding Anterior Cruciate Ligament Reconstruction. Arthroscopy. 2024;40(7):2067. doi:10.1016/j.arthro.2024.01.017

BibTeX
@article{Johns2024,
  author = {Johns, William L and Martinazzi, Brandon J and Miltenberg, Benjamin and Nam, Hannah H and Hammoud, Sommer},
  title = {ChatGPT Provides Unsatisfactory Responses to Frequently Asked Questions Regarding Anterior Cruciate Ligament Reconstruction},
  journal = {Arthroscopy},
  year = {2024},
  volume = {40},
  number = {7},
  pages = {2067},
  doi = {10.1016/j.arthro.2024.01.017}
}
Kostenlos starten →