Revolutionizing inflammatory bowel disease healthcare communication: a head-to-head comparison of gastroenterologist and ChatGPT responses
Gastroenterology Report · 11.01.2025 · 13
DOI: 10.1093/gastro/goaf087 ↗Kurz gefasst
Fachartikel in der Zeitschrift Gastroenterology Report, online erschienen am 30.09.2025. Verfasst von Zixuan He und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, P. R. China. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Background
Artificial intelligence-driven large language models demonstrate immense potential in the medical field. It remains unclear whether ChatGPT has the ability to provide appropriate recommendations for patients with inflammatory bowel disease (IBD) that are comparable to those of gastroenterologists. This study quantitatively assessed the performance of ChatGPT’s generated IBD-related recommendations from the distinct perspectives of gastroenterologists and patients.
Methods
Healthcare questions regarding IBD were solicited from IBD patients and specialized physicians. Those questions were then presented to GPT-4 Omni and three independent senior gastroenterologists for responses. These responses were subsequently evaluated by a blinded panel of five board-certified gastroenterologists using a five-point Likert scale, assessing accuracy, completeness, and readability. Furthermore, 10 IBD patients as blinded assessors performed assessments of both ChatGPT’s and gastroenterologists’ responses.
Results
Thirty high-frequency questions were selected, encompassing basic knowledge, treatment, and management domains. ChatGPT demonstrated high reproducibility in responding to these questions. Regarding accuracy and readability, ChatGPT’s performance was comparable to that of gastroenterologists. For completeness of responses, ChatGPT outperformed gastroenterologists (4.42 ± 0.67 vs 4.19 ± 0.65; P = 0.012). Overall, IBD patients were satisfied with both ChatGPT’s and gastroenterologists’ responses but, for treatment-related questions, patients rated gastroenterologists higher than ChatGPT (4.54 ± 0.32 vs 4.21 ± 0.38; P = 0.040).
Conclusions
ChatGPT has the potential to provide stable, accurate, comprehensive, and comprehensible healthcare-related information for IBD patients. Further validation of the reliability and practicality of large language models in real-world clinical settings is crucial.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
- Changhai Clinical Research Unit, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
- Department of Gastroenterology, Shanghai Changzheng Hospital, Naval Medical University, Shanghai, P. R. China.
- Department of Colorectal Surgery, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
- Department of Pharmacy, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
- Department of Clinical Nutrition, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
ORCID-Profile: Zixuan He
Förderung
- National Natural Science Foundation of China
Zitieren
APA
He, Z., Liu, Y., Wang, Z., Zhou, X., Fan, X., He, M., Wang, C., Fu, H., Wang, Z., & Bai, Y. (2025). Revolutionizing inflammatory bowel disease healthcare communication: a head-to-head comparison of gastroenterologist and ChatGPT responses. Gastroenterology Report, 13. https://doi.org/10.1093/gastro/goaf087
Vancouver
He Z, Liu Y, Wang Z, Zhou X, Fan X, He M, et al. Revolutionizing inflammatory bowel disease healthcare communication: a head-to-head comparison of gastroenterologist and ChatGPT responses. Gastroenterology Report. 2025;13. doi:10.1093/gastro/goaf087
BibTeX
@article{He2025,
author = {He, Zixuan and Liu, Yilong and Wang, Zhaoming and Zhou, Xiaoyu and Fan, Xuanming and He, Miao and Wang, Chengcheng and Fu, Hongyu and Wang, Zhijie and Bai, Yu},
title = {Revolutionizing inflammatory bowel disease healthcare communication: a head-to-head comparison of gastroenterologist and ChatGPT responses},
journal = {Gastroenterology Report},
year = {2025},
volume = {13},
doi = {10.1093/gastro/goaf087}
}
EUVIMED