EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Gut Instincts, Machine Decisions: Evaluating AI Accuracy in the Diagnosis and Treatment of Disorders of Gut‐Brain Interaction

Matthew Ahn iD, Colleen H Parker

Neurogastroenterology & Motility · 2026-07 · 38 (7)

DOI: 10.1111/nmo.70393 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neurogastroenterology & Motility, online erschienen am 10.07.2026. Verfasst von Matthew Ahn und 1 weiteren Autor:innen. Beteiligte Einrichtung: Temerty Faculty of Medicine, University of Toronto, Toronto, Canada. Hauptthemen laut MEDLINE: Gastrointestinal Diseases, Artificial Intelligence, Brain-Gut Axis. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Disorders of Gut‐Brain Interaction (DGBIs) are common yet challenging diagnoses for gastroenterologists and primary care clinicians. Large language models (LLMs) may support clinical management, but their accuracy remains poorly defined. This study evaluated the diagnostic and treatment accuracy of five LLMs using a convenience sample of clinical scenarios from the Rome IV Multidimensional Clinical Profile (MDCP).

Methods

Sixty eight cases representing the DGBIs were entered into commonly accessible, untrained LLMs: ChatGPT 4.0, Google Gemini 2.5 Pro, Microsoft Copilot, OpenEvidence, and Perplexity. A standardized prompt elicited a diagnosis, treatment options, and confidence ratings for each diagnosis. Outputs were assessed against the MDCP recommendations and expert opinion. Key Results Diagnostic accuracy across models demonstrated Perplexity at 74%, ChatGPT and Google Gemini at 72% respectively, and Microsoft Copilot and OpenEvidence at 65% respectively. Treatment accuracy across models demonstrated ChatGPT, Google Gemini, and Microsoft Copilot generating accurate treatment options between 53% and 54% of cases each, compared with 41% for OpenEvidence and Perplexity each. No statistically significant differences were observed between AI models for diagnostic or treatment accuracy. Confidence ratings were uniformly high regardless of accuracy, with the mean scores ranging from 93% to 96% and standard deviation ranging from 1% to 4%. Conclusions and Inferences Untrained LLMs demonstrated promising but imperfect diagnostic and treatment performance in this study of a convenience sample of DGBI cases. High confidence despite diagnostic errors and inconsistent treatment recommendations highlights the need for cautious clinical integration and validation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Gastrointestinal DiseasesArtificial IntelligenceBrain-Gut AxisHumansLarge Language ModelsGenerative Artificial IntelligenceFemaleIntelligent Systems

Stichwörter der Autor:innen

DGBIartificial intelligencediagnostic accuracydisorders of gut‐brain interactionlarge language models

Autor:innen und Institutionen

  • Temerty Faculty of Medicine, University of Toronto, Toronto, Canada.
  • Division of Gastroenterology & Hepatology, Department of Medicine, University of Toronto, Toronto, Canada.
  • Division of Gastroenterology & Hepatology, University Health Network, Toronto, Canada.

ORCID-Profile: Matthew Ahn

Zitieren

APA

Ahn, M., & Parker, C. H. (2026). Gut Instincts, Machine Decisions: Evaluating AI Accuracy in the Diagnosis and Treatment of Disorders of Gut‐Brain Interaction. Neurogastroenterology & Motility, 38(7). https://doi.org/10.1111/nmo.70393

Vancouver

Ahn M, Parker CH. Gut Instincts, Machine Decisions: Evaluating AI Accuracy in the Diagnosis and Treatment of Disorders of Gut‐Brain Interaction. Neurogastroenterology & Motility. 2026;38(7). doi:10.1111/nmo.70393

BibTeX
@article{Ahn2026,
  author = {Ahn, Matthew and Parker, Colleen H},
  title = {Gut Instincts, Machine Decisions: Evaluating AI Accuracy in the Diagnosis and Treatment of Disorders of Gut‐Brain Interaction},
  journal = {Neurogastroenterology & Motility},
  year = {2026},
  volume = {38},
  number = {7},
  doi = {10.1111/nmo.70393}
}
Kostenlos starten →