EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Revolutionizing inflammatory bowel disease healthcare communication: a head-to-head comparison of gastroenterologist and ChatGPT responses

Zixuan He iD, Yilong Liu, Zhaoming Wang, Xiaoyu Zhou, Xuanming Fan, Miao He, Chengcheng Wang, Hongyu Fu, Zhijie Wang, Yu Bai

Gastroenterology Report · 11.01.2025 · 13

DOI: 10.1093/gastro/goaf087 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Gastroenterology Report, online erschienen am 30.09.2025. Verfasst von Zixuan He und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, P. R. China. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial intelligence-driven large language models demonstrate immense potential in the medical field. It remains unclear whether ChatGPT has the ability to provide appropriate recommendations for patients with inflammatory bowel disease (IBD) that are comparable to those of gastroenterologists. This study quantitatively assessed the performance of ChatGPT’s generated IBD-related recommendations from the distinct perspectives of gastroenterologists and patients.

Methods

Healthcare questions regarding IBD were solicited from IBD patients and specialized physicians. Those questions were then presented to GPT-4 Omni and three independent senior gastroenterologists for responses. These responses were subsequently evaluated by a blinded panel of five board-certified gastroenterologists using a five-point Likert scale, assessing accuracy, completeness, and readability. Furthermore, 10 IBD patients as blinded assessors performed assessments of both ChatGPT’s and gastroenterologists’ responses.

Results

Thirty high-frequency questions were selected, encompassing basic knowledge, treatment, and management domains. ChatGPT demonstrated high reproducibility in responding to these questions. Regarding accuracy and readability, ChatGPT’s performance was comparable to that of gastroenterologists. For completeness of responses, ChatGPT outperformed gastroenterologists (4.42 ± 0.67 vs 4.19 ± 0.65; P = 0.012). Overall, IBD patients were satisfied with both ChatGPT’s and gastroenterologists’ responses but, for treatment-related questions, patients rated gastroenterologists higher than ChatGPT (4.54 ± 0.32 vs 4.21 ± 0.38; P = 0.040).

Conclusions

ChatGPT has the potential to provide stable, accurate, comprehensive, and comprehensible healthcare-related information for IBD patients. Further validation of the reliability and practicality of large language models in real-world clinical settings is crucial.

Schlagwörter

Stichwörter der Autor:innen

GPT-4 Omniinflammatory bowel diseaselarge language modelspatient education

Autor:innen und Institutionen

  • Department of Gastroenterology, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
  • Changhai Clinical Research Unit, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
  • Department of Gastroenterology, Shanghai Changzheng Hospital, Naval Medical University, Shanghai, P. R. China.
  • Department of Colorectal Surgery, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
  • Department of Pharmacy, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.
  • Department of Clinical Nutrition, Changhai Hospital, Naval Medical University, Shanghai, P. R. China.

ORCID-Profile: Zixuan He

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

He, Z., Liu, Y., Wang, Z., Zhou, X., Fan, X., He, M., Wang, C., Fu, H., Wang, Z., & Bai, Y. (2025). Revolutionizing inflammatory bowel disease healthcare communication: a head-to-head comparison of gastroenterologist and ChatGPT responses. Gastroenterology Report, 13. https://doi.org/10.1093/gastro/goaf087

Vancouver

He Z, Liu Y, Wang Z, Zhou X, Fan X, He M, et al. Revolutionizing inflammatory bowel disease healthcare communication: a head-to-head comparison of gastroenterologist and ChatGPT responses. Gastroenterology Report. 2025;13. doi:10.1093/gastro/goaf087

BibTeX
@article{He2025,
  author = {He, Zixuan and Liu, Yilong and Wang, Zhaoming and Zhou, Xiaoyu and Fan, Xuanming and He, Miao and Wang, Chengcheng and Fu, Hongyu and Wang, Zhijie and Bai, Yu},
  title = {Revolutionizing inflammatory bowel disease healthcare communication: a head-to-head comparison of gastroenterologist and ChatGPT responses},
  journal = {Gastroenterology Report},
  year = {2025},
  volume = {13},
  doi = {10.1093/gastro/goaf087}
}
Kostenlos starten →