Assessing the quality and readability of ChatGPT responses to frequently asked questions about trigger finger release
Journal of Plastic, Reconstructive & Aesthetic Surgery · 2025
DOI: 10.1016/j.bjps.2025.04.033 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Plastic, Reconstructive & Aesthetic Surgery, 2025. Verfasst von Sohil N Dharia und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Orthopaedic Surgery, Albany Medical Center, Albany, NY, USA. Electronic address: dharias1@amc.edu. Hauptthemen laut MEDLINE: Comprehension, Trigger Finger Disorder, Artificial Intelligence. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 5 Literaturangaben.
Abstract (Originalsprache)
Artificial intelligence, specifically large language models like ChatGPT, is rapidly transforming the healthcare landscape. As ChatGPT becomes more popular for obtaining medical information, there are concerns regarding the accuracy and quality of its content. While prior studies in various medical specialties have yielded mixed results regarding ChatGPT's reliability, little research has focused on its ability to address questions regarding specific orthopedic procedures, such as surgical intervention for stenosing tenosynovitis (trigger finger). This study assessed the accuracy, clarity, and readability of ChatGPT's responses to ten commonly asked patient questions regarding trigger finger release. The questions were obtained from Google's "People also ask" section and queried in ChatGPT 4.0 on September 24, 2024. Responses were evaluated by two authors using a four-point accuracy scale. Additionally, the education level required to understand the responses was assessed using the Flesch-Kincaid scale. ChatGPT's responses achieved an average score of 1.9, falling between "excellent, requiring no clarification" and "satisfactory, requiring minimal clarification." Although the chatbot provided largely accurate information, it produced an incorrect response in one case and displayed occasional factual inaccuracies, particularly regarding treatment recommendations. The average reading level of responses was at a 12th-grade level, which exceeds the recommended 7th-8th-grade level for patient materials. ChatGPT can serve as a useful starting point for patients seeking information about orthopedic procedures like trigger finger release, but healthcare providers should guide patients in validating AI-generated content to enhance medical literacy and ensure accurate understanding.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Orthopaedic Surgery, Albany Medical Center, Albany, NY, USA. Electronic address: dharias1@amc.edu.
- Department of Orthopaedic Surgery, Albany Medical Center, Albany, NY, USA.
Zitieren
APA
Dharia, S. N., Traversone, J., Wortman, R., & Mulligan, M. (2025). Assessing the quality and readability of ChatGPT responses to frequently asked questions about trigger finger release. Journal of Plastic, Reconstructive & Aesthetic Surgery. https://doi.org/10.1016/j.bjps.2025.04.033
Vancouver
Dharia SN, Traversone J, Wortman R, Mulligan M. Assessing the quality and readability of ChatGPT responses to frequently asked questions about trigger finger release. Journal of Plastic, Reconstructive & Aesthetic Surgery. 2025. doi:10.1016/j.bjps.2025.04.033
BibTeX
@article{Dharia2025,
author = {Dharia, Sohil N and Traversone, John and Wortman, Ryan and Mulligan, Michael},
title = {Assessing the quality and readability of ChatGPT responses to frequently asked questions about trigger finger release},
journal = {Journal of Plastic, Reconstructive & Aesthetic Surgery},
year = {2025},
doi = {10.1016/j.bjps.2025.04.033}
}
EUVIMED