Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology
Journal of Surgical Oncology · 2024
DOI: 10.1002/jso.27715 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Surgical Oncology, 2024. Verfasst von Estefania Roldan-Vasquez und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, Breast Surgical Oncology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA. Hauptthemen laut MEDLINE: Artificial Intelligence, Breast Neoplasms, Surgical Oncology. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 18 Literaturangaben.
Abstract (Originalsprache)
Introduction
Artificial intelligence (AI)‐driven chatbots, capable of simulating human‐like conversations, are becoming more prevalent in healthcare. While this technology offers potential benefits in patient engagement and information accessibility, it raises concerns about potential misuse, misinformation, inaccuracies, and ethical challenges.
Methods
This study evaluated a publicly available AI chatbot, ChatGPT, in its responses to nine questions related to breast cancer surgery selected from the American Society of Breast Surgeons' frequently asked questions (FAQ) patient education website. Four breast surgical oncologists assessed the responses for accuracy and reliability using a five‐point Likert scale and the Patient Education Materials Assessment (PEMAT) Tool.
Results
The average reliability score for ChatGPT in answering breast cancer surgery questions was 3.98 out of 5.00. Surgeons unanimously found the responses understandable and actionable per the PEMAT criteria. The consensus found ChatGPT's overall performance was appropriate, with minor or no inaccuracies.
Conclusion
ChatGPT demonstrates good reliability in responding to breast cancer surgery queries, with minor, nonharmful inaccuracies. Its answers are accurate, clear, and easy to comprehend. Notably, ChatGPT acknowledged its informational role and did not attempt to replace medical advice or discourage users from seeking input from a healthcare professional.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Surgery, Breast Surgical Oncology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA.
- School of Medicine and Dentistry, University of Rochester, Rochester, New York, USA.
- Department of Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.
Zitieren
APA
Roldan-Vasquez, E., Mitri, S., Bhasin, S., Bharani, T., Capasso, K., Haslinger, M., Sharma, R., & James, T. A. (2024). Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology. Journal of Surgical Oncology. https://doi.org/10.1002/jso.27715
Vancouver
Roldan-Vasquez E, Mitri S, Bhasin S, Bharani T, Capasso K, Haslinger M, et al. Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology. Journal of Surgical Oncology. 2024. doi:10.1002/jso.27715
BibTeX
@article{RoldanVasquez2024,
author = {Roldan-Vasquez, Estefania and Mitri, Samir and Bhasin, Shreya and Bharani, Tina and Capasso, Kathryn and Haslinger, Michelle and Sharma, Ranjna and James, Ted A},
title = {Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology},
journal = {Journal of Surgical Oncology},
year = {2024},
doi = {10.1002/jso.27715}
}
EUVIMED