“Doctor ChatGPT, Can You Help Me?” The Patient’s Perspective: Cross-Sectional Study
Journal of Medical Internet Research · 01.10.2024 · 26 · e58831
DOI: 10.2196/58831 ↗Kurz gefasst
Querschnittstudie in der Zeitschrift Journal of Medical Internet Research, online erschienen am 01.10.2024. Verfasst von Jonas Armbruster und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Trauma and Orthopedic Surgery, BG Klinik Ludwigshafen, Ludwigshafen am Rhein, Germany. Hauptthemen laut MEDLINE: Physician-Patient Relations. Die Arbeit wurde bisher 96-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Artificial intelligence and the language models derived from it, such as ChatGPT, offer immense possibilities, particularly in the field of medicine. It is already evident that ChatGPT can provide adequate and, in some cases, expert-level responses to health-related queries and advice for patients. However, it is currently unknown how patients perceive these capabilities, whether they can derive benefit from them, and whether potential risks, such as harmful suggestions, are detected by patients.
Objective
This study aims to clarify whether patients can get useful and safe health care advice from an artificial intelligence chatbot assistant.
Methods
This cross-sectional study was conducted using 100 publicly available health-related questions from 5 medical specialties (trauma, general surgery, otolaryngology, pediatrics, and internal medicine) from a web-based platform for patients. Responses generated by ChatGPT-4.0 and by an expert panel (EP) of experienced physicians from the aforementioned web-based platform were packed into 10 sets consisting of 10 questions each. The blinded evaluation was carried out by patients regarding empathy and usefulness (assessed through the question: “Would this answer have helped you?”) on a scale from 1 to 5. As a control, evaluation was also performed by 3 physicians in each respective medical specialty, who were additionally asked about the potential harm of the response and its correctness.
Results
In total, 200 sets of questions were submitted by 64 patients (mean 45.7, SD 15.9 years; 29/64, 45.3% male), resulting in 2000 evaluated answers of ChatGPT and the EP each. ChatGPT scored higher in terms of empathy (4.18 vs 2.7; P
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Trauma and Orthopedic Surgery, BG Klinik Ludwigshafen, Ludwigshafen am Rhein, Germany.
ORCID-Profile: Jonas Armbruster, Florian Bussmann, Catharina Rothhaas, Nadine Titze, Paul Alfred Grützner, Holger Freischmidt
Zitieren
APA
Armbruster, J., Bussmann, F., Rothhaas, C., Titze, N., Grützner, P. A., & Freischmidt, H. (2024). “Doctor ChatGPT, Can You Help Me?” The Patient’s Perspective: Cross-Sectional Study. Journal of Medical Internet Research, 26, e58831. https://doi.org/10.2196/58831
Vancouver
Armbruster J, Bussmann F, Rothhaas C, Titze N, Grützner PA, Freischmidt H. “Doctor ChatGPT, Can You Help Me?” The Patient’s Perspective: Cross-Sectional Study. Journal of Medical Internet Research. 2024;26:e58831. doi:10.2196/58831
BibTeX
@article{Armbruster2024,
author = {Armbruster, Jonas and Bussmann, Florian and Rothhaas, Catharina and Titze, Nadine and Grützner, Paul Alfred and Freischmidt, Holger},
title = {“Doctor ChatGPT, Can You Help Me?” The Patient’s Perspective: Cross-Sectional Study},
journal = {Journal of Medical Internet Research},
year = {2024},
volume = {26},
pages = {e58831},
doi = {10.2196/58831}
}
EUVIMED