EUVIMEDEUVIMED entdecken
Leitlinie

Detail Coverage and Evidence Integration: Evaluating ChatGPT 5.0 and DeepSeek R1 in Guideline‐Based Crohn's Disease Applications

Hutao Zhou, Tao Yuan, Yueji Ning, Boneng Mao, Mengping Zhu iD

Journal of Evaluation in Clinical Practice · 2026-04 · 32 (3)

DOI: 10.1111/jep.70440 ↗

Kurz gefasst

Leitlinie in der Zeitschrift Journal of Evaluation in Clinical Practice, online erschienen am 21.04.2026. Verfasst von Hutao Zhou und 4 weiteren Autor:innen. Beteiligte Einrichtung: Yixing People's Hospital, Yixing, Wuxi, Jiangsu Province, China. Hauptthemen laut MEDLINE: Crohn Disease, Practice Guidelines as Topic, Decision Support Systems, Clinical. Die Arbeit nennt 25 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Crohn's disease (CD) requires accurate, guideline‐based diagnosis and management, yet the growing complexity of therapeutic options and international recommendations creates challenges for timely clinical decision‐making. Large language models (LLMs) have emerged as potential tools for clinical decision support, but their performance in guideline‐based gastroenterology remains insufficiently characterized.

Methods

We conducted a structured comparative evaluation of ChatGPT 5.0 and DeepSeek R1 using 47 standardized clinical questions derived from the 2023 Chinese guidelines for the diagnosis and treatment of CD. Each question was submitted independently to both models under identical conditions, without iterative clarification. Responses were assessed across multiple dimensions, including coverage, guideline consistency, agreement, response length, detail coverage, readability, and structural clarity. Domain‐specific analyses were performed for diagnostic, therapeutic, and surgical/management questions.

Results

Both models demonstrated high alignment with guideline‐based recommendations, with guideline consistency rates of 93% for ChatGPT 5.0% and 96% for DeepSeek R1, and an inter‐model agreement rate of approximately 87%. ChatGPT 5.0 showed complete detail coverage across diagnostic, therapeutic, and surgical/management domains (100%) and generated shorter, more concise responses (mean 208 words; range 142–300) with higher readability (mean 4.6/5). DeepSeek R1 achieved 87.5% overall detail coverage, with slightly lower performance in diagnostic (88.2%) and therapeutic (85.2%) categories but equivalent performance in surgical/management questions. Its responses were longer (mean 291 words; range 128–417) and incorporated more trial data, drug comparisons, and cross‐guideline references, although readability was lower (mean 3.4/5).

Conclusions

ChatGPT 5.0 and DeepSeek R1 demonstrated distinct yet complementary strengths in guideline‐based CD applications. ChatGPT 5.0 functioned more effectively as a clinical‐ready assistant by providing concise, highly readable, and actionable outputs, whereas DeepSeek R1 was better suited to academic and research‐oriented contexts through deeper evidence integration. A hybrid workflow combining rapid point‐of‐care support from ChatGPT 5.0 with evidence synthesis from DeepSeek R1 may offer optimal utility. Further real‐world validation is needed before routine clinical implementation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Crohn DiseasePractice Guidelines as TopicDecision Support Systems, ClinicalHumansLarge Language ModelsClinical Decision-MakingChina

Autor:innen und Institutionen

  • Yixing People's Hospital, Yixing, Wuxi, Jiangsu Province, China.

ORCID-Profile: Mengping Zhu

Zitieren

APA

Zhou, H., Yuan, T., Ning, Y., Mao, B., & Zhu, M. (2026). Detail Coverage and Evidence Integration: Evaluating ChatGPT 5.0 and DeepSeek R1 in Guideline‐Based Crohn's Disease Applications. Journal of Evaluation in Clinical Practice, 32(3). https://doi.org/10.1111/jep.70440

Vancouver

Zhou H, Yuan T, Ning Y, Mao B, Zhu M. Detail Coverage and Evidence Integration: Evaluating ChatGPT 5.0 and DeepSeek R1 in Guideline‐Based Crohn's Disease Applications. Journal of Evaluation in Clinical Practice. 2026;32(3). doi:10.1111/jep.70440

BibTeX
@article{Zhou2026,
  author = {Zhou, Hutao and Yuan, Tao and Ning, Yueji and Mao, Boneng and Zhu, Mengping},
  title = {Detail Coverage and Evidence Integration: Evaluating ChatGPT 5.0 and DeepSeek R1 in Guideline‐Based Crohn's Disease Applications},
  journal = {Journal of Evaluation in Clinical Practice},
  year = {2026},
  volume = {32},
  number = {3},
  doi = {10.1111/jep.70440}
}
Kostenlos starten →