Assessing the Quality of ChatGPT’s Dietary Advice for College Students from Dietitians’ Perspectives
Nutrients · 19.06.2024 · 16 (12) · 1939
DOI: 10.3390/nu16121939 ↗Kurz gefasst
Fachartikel in der Zeitschrift Nutrients, online erschienen am 19.06.2024. Verfasst von Li-Ling Liao und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Public Health, College of Health Science, Kaohsiung Medical University, Kaohsiung City 807378, Taiwan. Hauptthemen laut MEDLINE: Students, Nutritionists. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
As ChatGPT becomes a primary information source for college students, its performance in providing dietary advice is under scrutiny. This study assessed ChatGPT’s performance in providing nutritional guidance to college students.
Methods
ChatGPT’s performance on dietary advice was evaluated by 30 experienced dietitians and assessed using an objective nutrition literacy (NL) test. The dietitians were recruited to assess the quality of ChatGPT’s dietary advice, including its NL achievement and response quality.
Results
The results indicate that ChatGPT’s performance varies across scenarios and is suboptimal for achieving NL with full achievement rates from 7.50% to 37.56%. While the responses excelled in readability, they lacked understandability, practicality, and completeness. In the NL test, ChatGPT showed an 84.38% accuracy rate, surpassing the NL level of Taiwanese college students. The top concern among the dietitians, cited 52 times in 242 feedback entries, was that the “response information lacks thoroughness or rigor, leading to misunderstandings or misuse”. Despite the potential of ChatGPT as a supplementary educational tool, significant gaps must be addressed, especially in detailed dietary inquiries.
Conclusion
This study highlights the need for improved AI educational approaches and suggests the potential for developing ChatGPT teaching guides or usage instructions to train college students and support dietitians.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Public Health, College of Health Science, Kaohsiung Medical University, Kaohsiung City 807378, Taiwan.
- Department of Medical Research, Kaohsiung Medical University Hospital, Kaohsiung City 807378, Taiwan.
- School of Nursing, Chang Gung University of Science and Technology, Tao-Yuan 333324, Taiwan.
- School of Nursing, College of Medicine, Chang Gung University, Tao-Yuan 333323, Taiwan.
- Department of Nursing, Linkou Chang Gung Memorial Hospital, Linkou 333423, Taiwan.
- Department of Nutrition, I-Shou University, Kaohsiung City 824005, Taiwan.
ORCID-Profile: Li-Ling Liao, Li-Chun Chang, I-Ju Lai
Zitieren
APA
Liao, L. L., Chang, L. C., & Lai, I. J. (2024). Assessing the Quality of ChatGPT’s Dietary Advice for College Students from Dietitians’ Perspectives. Nutrients, 16(12), 1939. https://doi.org/10.3390/nu16121939
Vancouver
Liao LL, Chang LC, Lai IJ. Assessing the Quality of ChatGPT’s Dietary Advice for College Students from Dietitians’ Perspectives. Nutrients. 2024;16(12):1939. doi:10.3390/nu16121939
BibTeX
@article{Liao2024,
author = {Liao, Li-Ling and Chang, Li-Chun and Lai, I-Ju},
title = {Assessing the Quality of ChatGPT’s Dietary Advice for College Students from Dietitians’ Perspectives},
journal = {Nutrients},
year = {2024},
volume = {16},
number = {12},
pages = {1939},
doi = {10.3390/nu16121939}
}
EUVIMED