EUVIMEDEUVIMED entdecken
Crossref

Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology

Estefania Roldan-Vasquez, Samir Mitri, Shreya Bhasin, Tina Bharani, Kathryn Capasso, Michelle Haslinger, Ranjna Sharma, Ted A James

Journal of Surgical Oncology · 2024

DOI: 10.1002/jso.27715 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Surgical Oncology, 2024. Verfasst von Estefania Roldan-Vasquez und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, Breast Surgical Oncology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA. Hauptthemen laut MEDLINE: Artificial Intelligence, Breast Neoplasms, Surgical Oncology. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 18 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Artificial intelligence (AI)‐driven chatbots, capable of simulating human‐like conversations, are becoming more prevalent in healthcare. While this technology offers potential benefits in patient engagement and information accessibility, it raises concerns about potential misuse, misinformation, inaccuracies, and ethical challenges.

Methods

This study evaluated a publicly available AI chatbot, ChatGPT, in its responses to nine questions related to breast cancer surgery selected from the American Society of Breast Surgeons' frequently asked questions (FAQ) patient education website. Four breast surgical oncologists assessed the responses for accuracy and reliability using a five‐point Likert scale and the Patient Education Materials Assessment (PEMAT) Tool.

Results

The average reliability score for ChatGPT in answering breast cancer surgery questions was 3.98 out of 5.00. Surgeons unanimously found the responses understandable and actionable per the PEMAT criteria. The consensus found ChatGPT's overall performance was appropriate, with minor or no inaccuracies.

Conclusion

ChatGPT demonstrates good reliability in responding to breast cancer surgery queries, with minor, nonharmful inaccuracies. Its answers are accurate, clear, and easy to comprehend. Notably, ChatGPT acknowledged its informational role and did not attempt to replace medical advice or discourage users from seeking input from a healthcare professional.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceBreast NeoplasmsSurgical OncologyHumansFemaleReproducibility of ResultsPatient Education as TopicSurveys and QuestionnairesCommunication

Stichwörter der Autor:innen

ChatGPTartificial intelligencebreast cancereducationsurgery

Autor:innen und Institutionen

  • Department of Surgery, Breast Surgical Oncology, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, Massachusetts, USA.
  • School of Medicine and Dentistry, University of Rochester, Rochester, New York, USA.
  • Department of Surgery, Brigham and Women's Hospital, Harvard Medical School, Boston, Massachusetts, USA.

Zitieren

APA

Roldan-Vasquez, E., Mitri, S., Bhasin, S., Bharani, T., Capasso, K., Haslinger, M., Sharma, R., & James, T. A. (2024). Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology. Journal of Surgical Oncology. https://doi.org/10.1002/jso.27715

Vancouver

Roldan-Vasquez E, Mitri S, Bhasin S, Bharani T, Capasso K, Haslinger M, et al. Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology. Journal of Surgical Oncology. 2024. doi:10.1002/jso.27715

BibTeX
@article{RoldanVasquez2024,
  author = {Roldan-Vasquez, Estefania and Mitri, Samir and Bhasin, Shreya and Bharani, Tina and Capasso, Kathryn and Haslinger, Michelle and Sharma, Ranjna and James, Ted A},
  title = {Reliability of artificial intelligence chatbot responses to frequently asked questions in breast surgical oncology},
  journal = {Journal of Surgical Oncology},
  year = {2024},
  doi = {10.1002/jso.27715}
}
Kostenlos starten →