Appropriateness of ChatGPT in Answering Heart Failure Related Questions
Heart, Lung and Circulation · 2024-09 · 33 (9) · 1314-1318
DOI: 10.1016/j.hlc.2024.03.005 ↗Kurz gefasst
Fachartikel in der Zeitschrift Heart, Lung and Circulation, 2024-09. Verfasst von Ryan C King und 5 weiteren Autor:innen. Beteiligte Einrichtung: Division of Cardiology, Department of Medicine, Irvine Medical Center, University of California, Orange, CA, USA. Electronic address: kingrc@hs.uci.e…. Hauptthemen laut MEDLINE: Heart Failure. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 13 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Themen: Herzinsuffizienz, Künstliche Intelligenz in der Pflege
Abstract (Originalsprache)
BACKGROUND: Heart failure requires complex management, and increased patient knowledge has been shown to improve outcomes. This study assessed the knowledge of Chat Generative Pre-trained Transformer (ChatGPT) and its appropriateness as a supplemental resource of information for patients with heart failure. METHOD: A total of 107 frequently asked heart failure-related questions were included in 3 categories: "basic knowledge" (49), "management" (41) and "other" (17). Two responses per question were generated using both GPT-3.5 and GPT-4 (i.e., two responses per question per model). The accuracy and reproducibility of responses were graded by two reviewers, board-certified in cardiology, with differences resolved by a third reviewer, board-certified in cardiology and advanced heart failure. Accuracy was graded using a four-point scale: (1) comprehensive, (2) correct but inadequate, (3) some correct and some incorrect, and (4) completely incorrect. RESULTS: GPT-4 provided 107/107 (100%) responses with correct information. Further, GPT-4 displayed a greater proportion of comprehensive knowledge for the categories of "basic knowledge" and "management" (89.8% and 82.9%, respectively). For GPT-3, there were two total responses (1.9%) graded as "some correct and incorrect" for GPT-3.5, while no "completely incorrect" responses were produced. With respect to comprehensive knowledge, GPT-3.5 performed best in the "management" category and "other" category (prognosis, procedures, and support) (78.1%, 94.1%). The models also provided highly reproducible responses, with GPT-3.5 scoring above 94% in every category and GPT-4 with 100% for all answers. CONCLUSIONS: GPT-3.5 and GPT-4 answered the majority of heart failure-related questions accurately and reliably. If validated in future studies, ChatGPT may serve as a useful tool in the future by providing accessible health-related information and education to patients living with heart failure. In its current state, ChatGPT necessitates further rigorous testing and validation to ensure patient safety and equity across all patient demographics.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Cardiology, Department of Medicine, Irvine Medical Center, University of California, Orange, CA, USA. Electronic address: kingrc@hs.uci.edu.
- Karsh Division of Gastroenterology and Hepatology, Department of Medicine, Cedars-Sinai Medical Center, Los Angeles, CA, USA.
- Division of Cardiology, Department of Medicine, Irvine Medical Center, University of California, Orange, CA, USA.
Zitieren
APA
King, R. C., Samaan, J. S., Yeo, Y. H., Mody, B., Lombardo, D. M., & Ghashghaei, R. (2024). Appropriateness of ChatGPT in Answering Heart Failure Related Questions. Heart, Lung and Circulation, 33(9), 1314-1318. https://doi.org/10.1016/j.hlc.2024.03.005
Vancouver
King RC, Samaan JS, Yeo YH, Mody B, Lombardo DM, Ghashghaei R. Appropriateness of ChatGPT in Answering Heart Failure Related Questions. Heart, Lung and Circulation. 2024;33(9):1314-1318. doi:10.1016/j.hlc.2024.03.005
BibTeX
@article{King2024,
author = {King, Ryan C and Samaan, Jamil S and Yeo, Yee Hui and Mody, Behram and Lombardo, Dawn M and Ghashghaei, Roxana},
title = {Appropriateness of ChatGPT in Answering Heart Failure Related Questions},
journal = {Heart, Lung and Circulation},
year = {2024},
volume = {33},
number = {9},
pages = {1314--1318},
doi = {10.1016/j.hlc.2024.03.005}
}
EUVIMED