EUVIMEDEUVIMED entdecken
Open Access

Readability of AI-Generated Patient Information Leaflets on Alzheimer’s, Vascular Dementia, and Delirium

Jamila Tukur Jido, Ahmed Al-Wizni, Su Le Aung

Cureus · 06.06.2025

DOI: 10.7759/cureus.85463 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cureus, erschienen am 06.06.2025. Verfasst von Jamila Tukur Jido und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medicine for the Elderly, Queen Elizabeth University Hospital, Glasgow, GBR. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Large language models such as ChatGPT, DeepSeek, and Gemini are increasingly used to generate patient-facing medical content. While their factual accuracy has been explored, the readability of these outputs remains less well understood. Readability is a crucial component of health communication, particularly for older adults and those with lower health literacy. This study aimed to evaluate and compare the readability of patient information leaflets generated by three large language models - ChatGPT, DeepSeek, and Gemini - on the topics of Alzheimer's disease, vascular dementia, and delirium, using five validated readability metrics. Materials and methods We conducted a cross-sectional comparative study of patient information leaflets generated by three large language models on the topics of Alzheimer's disease, vascular dementia, and delirium. Each model was prompted using identical queries, and the resulting texts were evaluated using five established readability metrics: Flesch Reading Ease, Flesch-Kincaid Grade Level, Gunning Fog Index, Simple Measure of Gobbledygook (SMOG) Index, and Automated Readability Index. Readability scores were compared using Kruskal-Wallis tests to identify statistically significant differences between models.

Results

ChatGPT consistently produced the most readable content, with the highest Flesch Reading Ease scores and the lowest grade-level indices. DeepSeek generated text that was markedly more complex and less accessible. Gemini performed intermediately, sometimes matching ChatGPT in specific indices but not consistently across all metrics. The difference in Flesch Reading Ease scores between models was statistically significant (H = 7.20, p = 0.027). Other metrics showed trends that approached significance.

Conclusions

There are meaningful differences in the readability of patient information generated by different large language models. ChatGPT appears to produce content that is more suitable for patient understanding, particularly in the context of older adult care. These findings highlight the need for careful evaluation of readability when using generative AI in clinical communication. Future research should incorporate expert review of content accuracy and appropriateness alongside readability.

Schlagwörter

Stichwörter der Autor:innen

alzheimer's diseasedementia vascularhypoactive deliriumpsychiatry of old agereadability analysis

Autor:innen und Institutionen

  • Department of Medicine for the Elderly, Queen Elizabeth University Hospital, Glasgow, GBR.
  • Department of Internal Medicine, Broomfield Hospital, Essex, GBR.
  • Department of Geriatric Medicine, Southend University Hospital NHS Foundation Trust, Southend-on-Sea, GBR.

Zitieren

APA

Tukur Jido, J., Al-Wizni, A., & Aung, S. L. (2025). Readability of AI-Generated Patient Information Leaflets on Alzheimer’s, Vascular Dementia, and Delirium. Cureus. https://doi.org/10.7759/cureus.85463

Vancouver

Tukur Jido J, Al-Wizni A, Aung SL. Readability of AI-Generated Patient Information Leaflets on Alzheimer’s, Vascular Dementia, and Delirium. Cureus. 2025. doi:10.7759/cureus.85463

BibTeX
@article{TukurJido2025,
  author = {Tukur Jido, Jamila and Al-Wizni, Ahmed and Aung, Su Le},
  title = {Readability of AI-Generated Patient Information Leaflets on Alzheimer’s, Vascular Dementia, and Delirium},
  journal = {Cureus},
  year = {2025},
  doi = {10.7759/cureus.85463}
}
Kostenlos starten →