Large Language Models for Dietary Advice to Patients With Irritable Bowel Syndrome: ChatGPT vs. Google Gemini
Journal of Human Nutrition and Dietetics · 2025-12 · 38 (6)
DOI: 10.1111/jhn.70162 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Human Nutrition and Dietetics, online erschienen am 18.11.2025. Verfasst von Merve Kip und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Nutrition and Dietetics, Nuh Naci Yazgan University, Kayseri, Turkey. Hauptthemen laut MEDLINE: Irritable Bowel Syndrome, Patient Education as Topic, Language. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 56 Literaturangaben. Gefördert von: This study was presented as a poster presentation at the 47th ESPEN Congress with the support of the Scientific and Technological Research Council of Turkey (T….
Abstract (Originalsprache)
Objectives
Large Language Models (LLM) like ChatGPT and Gemini have potential in nutrition applications, but recent studies suggest they provide inaccurate dietary advice. The aim of this study was to evaluate the most commonly used LLMs, ChatGPT and Gemini, for dietary recommendations for patients with irritable bowel syndrome (IBS).
Methods
Various tools were used to assess the responses of LLMs in this study. The Guideline Compliance Score was created using IBS guidelines. The quality of the responses provided by LLMs was assessed using The Global Quality Score (GQS) and Completeness, Lack of Misinformation, Evidence, Appropriateness, Relevance (CLEAR) tool. Understandability and actionability were assessed using the Patient Education Materials Assessment Tool (PEMAT). The readability of ChatGPT and Gemini's responses was evaluated using Flesch Reading Ease (FRE) and Flesch Kincaid Grade Level (FKGL).
Results
This study found that most responses from ChatGPT (70%) and Gemini (57.5%) were compliant with the guidelines, but there was no significant difference in guideline compliance, quality, understandability, actionability, or readability scores ( p > 0.05). The CLEAR tool showed a moderate positive correlation with PEMAT actionability ( r = 0.467, p = 0.038) and understandability ( r = 0.568, p = 0.009), a strong positive correlation with GQS ( r = 0.611, p = 0.004). In addition, FRE and FKGL had a strong negative correlation ( r = −0.784, p < 0.001), while the Guideline Compliance Score showed a moderate negative correlation with FRE ( r = −0.537, p = 0.015).
Conclusions
The study emphasizes the need for further model improvements before relying solely on LLMs in clinical nutrition practice, emphasizing the importance of dietitians' recommendations and the collaboration between AI models and healthcare teams.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Nutrition and Dietetics, Nuh Naci Yazgan University, Kayseri, Turkey.
ORCID-Profile: Merve Kip, Gaye Saban Bozan, Gizem Aytekin Sahin
Förderung
- This study was presented as a poster presentation at the 47th ESPEN Congress with the support of the Scientific and Technological Research Council of Turkey (T…
Zitieren
APA
Kip, M., Bozan, G. S., & Sahin, G. A. (2025). Large Language Models for Dietary Advice to Patients With Irritable Bowel Syndrome: ChatGPT vs. Google Gemini. Journal of Human Nutrition and Dietetics, 38(6). https://doi.org/10.1111/jhn.70162
Vancouver
Kip M, Bozan GS, Sahin GA. Large Language Models for Dietary Advice to Patients With Irritable Bowel Syndrome: ChatGPT vs. Google Gemini. Journal of Human Nutrition and Dietetics. 2025;38(6). doi:10.1111/jhn.70162
BibTeX
@article{Kip2025,
author = {Kip, Merve and Bozan, Gaye Saban and Sahin, Gizem Aytekin},
title = {Large Language Models for Dietary Advice to Patients With Irritable Bowel Syndrome: ChatGPT vs. Google Gemini},
journal = {Journal of Human Nutrition and Dietetics},
year = {2025},
volume = {38},
number = {6},
doi = {10.1111/jhn.70162}
}
EUVIMED