Exploring the role of an artificial intelligence chatbot on appendicitis management: an experimental study on ChatGPT
ANZ Journal of Surgery · 2024
DOI: 10.1111/ans.18736 ↗Kurz gefasst
Fachartikel in der Zeitschrift ANZ Journal of Surgery, 2024. Verfasst von Dylan Gracias und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgery, Townsville Hospital, Townsville, Queensland, Australia. Hauptthemen laut MEDLINE: Artificial Intelligence, Appendicitis. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 33 Literaturangaben.
Abstract (Originalsprache)
Background
Appendicitis is a common surgical condition that requires urgent medical attention. Recent advancements in artificial intelligence and large language processing, such as ChatGPT, have demonstrated potential in supporting healthcare management and scientific research. This study aims to evaluate the accuracy and comprehensiveness of ChatGPT's knowledge on appendicitis management.
Methods
Six questions related to appendicitis management were created by experienced RACS qualified general surgeons to assess ChatGPT's ability to provide accurate information. The criteria of ChatGPT answers' accuracy were compared with current healthcare guidelines for appendicitis and subjective evaluation by two RACS qualified General Surgeons. Additionally, ChatGPT was then asked to provide five high level evidence references to support its responses.
Results
ChatGPT provided clinically relevant information on appendicitis management, however, was inconsistent in doing so and often provided superficial information. Further to this, ChatGPT encountered difficulties in generating relevant references, with some being either non‐existent or incorrect.
Conclusion
ChatGPT has the potential to provide timely and comprehensible medical information on appendicitis management to laypersons. However, its issue of inaccuracy in information and production of non‐existent or erroneous references presents a challenge for researchers and clinicians who may inadvertently employ such information in their research or healthcare. Therefore, clinicians should exercise caution when using ChatGPT for these purposes.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Surgery, Townsville Hospital, Townsville, Queensland, Australia.
- Faculty of Medicine and Health, Central Clinical School, The University of Sydney, Sydney, New South Wales, Australia.
- Surgical Outcomes Research Centre (SOuRCe), Royal Prince Alfred Hospital, Camperdown, New South Wales, Australia.
- Concord Institute of Academic Surgery, Concord Hospital, Concord, New South Wales, Australia.
- Department of Surgery, Peninsula Health, Melbourne, Victoria, Australia.
- Department of Surgery, Bendigo Health, Bendigo, Victoria, Australia.
ORCID-Profile: Dylan Gracias, Adrian Siu, Ishith Seth, Angus Lee
Zitieren
APA
Gracias, D., Siu, A., Seth, I., Dooreemeah, D., & Lee, A. (2024). Exploring the role of an artificial intelligence chatbot on appendicitis management: an experimental study on ChatGPT. ANZ Journal of Surgery. https://doi.org/10.1111/ans.18736
Vancouver
Gracias D, Siu A, Seth I, Dooreemeah D, Lee A. Exploring the role of an artificial intelligence chatbot on appendicitis management: an experimental study on ChatGPT. ANZ Journal of Surgery. 2024. doi:10.1111/ans.18736
BibTeX
@article{Gracias2024,
author = {Gracias, Dylan and Siu, Adrian and Seth, Ishith and Dooreemeah, Dilshad and Lee, Angus},
title = {Exploring the role of an artificial intelligence chatbot on appendicitis management: an experimental study on ChatGPT},
journal = {ANZ Journal of Surgery},
year = {2024},
doi = {10.1111/ans.18736}
}
EUVIMED