Readability of AI-Generated Patient Information Leaflets on Alzheimer’s, Vascular Dementia, and Delirium
Cureus · 06.06.2025
DOI: 10.7759/cureus.85463 ↗Kurz gefasst
Fachartikel in der Zeitschrift Cureus, erschienen am 06.06.2025. Verfasst von Jamila Tukur Jido und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medicine for the Elderly, Queen Elizabeth University Hospital, Glasgow, GBR. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Large language models such as ChatGPT, DeepSeek, and Gemini are increasingly used to generate patient-facing medical content. While their factual accuracy has been explored, the readability of these outputs remains less well understood. Readability is a crucial component of health communication, particularly for older adults and those with lower health literacy. This study aimed to evaluate and compare the readability of patient information leaflets generated by three large language models - ChatGPT, DeepSeek, and Gemini - on the topics of Alzheimer's disease, vascular dementia, and delirium, using five validated readability metrics. Materials and methods We conducted a cross-sectional comparative study of patient information leaflets generated by three large language models on the topics of Alzheimer's disease, vascular dementia, and delirium. Each model was prompted using identical queries, and the resulting texts were evaluated using five established readability metrics: Flesch Reading Ease, Flesch-Kincaid Grade Level, Gunning Fog Index, Simple Measure of Gobbledygook (SMOG) Index, and Automated Readability Index. Readability scores were compared using Kruskal-Wallis tests to identify statistically significant differences between models.
Results
ChatGPT consistently produced the most readable content, with the highest Flesch Reading Ease scores and the lowest grade-level indices. DeepSeek generated text that was markedly more complex and less accessible. Gemini performed intermediately, sometimes matching ChatGPT in specific indices but not consistently across all metrics. The difference in Flesch Reading Ease scores between models was statistically significant (H = 7.20, p = 0.027). Other metrics showed trends that approached significance.
Conclusions
There are meaningful differences in the readability of patient information generated by different large language models. ChatGPT appears to produce content that is more suitable for patient understanding, particularly in the context of older adult care. These findings highlight the need for careful evaluation of readability when using generative AI in clinical communication. Future research should incorporate expert review of content accuracy and appropriateness alongside readability.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Medicine for the Elderly, Queen Elizabeth University Hospital, Glasgow, GBR.
- Department of Internal Medicine, Broomfield Hospital, Essex, GBR.
- Department of Geriatric Medicine, Southend University Hospital NHS Foundation Trust, Southend-on-Sea, GBR.
Zitieren
APA
Tukur Jido, J., Al-Wizni, A., & Aung, S. L. (2025). Readability of AI-Generated Patient Information Leaflets on Alzheimer’s, Vascular Dementia, and Delirium. Cureus. https://doi.org/10.7759/cureus.85463
Vancouver
Tukur Jido J, Al-Wizni A, Aung SL. Readability of AI-Generated Patient Information Leaflets on Alzheimer’s, Vascular Dementia, and Delirium. Cureus. 2025. doi:10.7759/cureus.85463
BibTeX
@article{TukurJido2025,
author = {Tukur Jido, Jamila and Al-Wizni, Ahmed and Aung, Su Le},
title = {Readability of AI-Generated Patient Information Leaflets on Alzheimer’s, Vascular Dementia, and Delirium},
journal = {Cureus},
year = {2025},
doi = {10.7759/cureus.85463}
}
EUVIMED