Comparative Analysis of Readability in AI-Generated Cerebrovascular Disease Patient Education Materials: ChatGPT vs Gemini
Acta Medica Young Doctors · 01.05.2026 · 2 (3)
DOI: 10.66288/actamedi.2026.85 ↗Kurz gefasst
Fachartikel in der Zeitschrift Acta Medica Young Doctors, online erschienen am 01.05.2026. Verfasst von Remziye Nur Okudan. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Themen: Selbstmanagement bei chronischen Erkrankungen, Künstliche Intelligenz in der Pflege
Abstract (Originalsprache)
Background
Cerebrovascular disease (CVD) is a leading cause of mortality and disability worldwide. Patient education plays a critical role in disease management; however, the effectiveness of such materials depends heavily on their readability. Artificial intelligence (AI) tools, such as ChatGPT and Gemini, are increasingly used to generate health information, yet their readability remains uncertain.
Objective
This study aimed to evaluate and compare the readability of CVD-related patient education materials generated by ChatGPT and Gemini using multiple validated readability indices.
Methods
A total of 40 educational texts on cerebrovascular disease were generated, with 20 texts produced by each AI platform using standardized prompts. Readability was assessed using the Automated Readability Index (ARI), Flesch Reading Ease (FRE), Flesch-Kincaid Grade Level (FKGL), Gunning Fog Scale, Coleman–Liau Index, SMOG index, Linsear Write Formula, and FORCAST readability formula. Mean values and standard deviations were calculated, and comparisons between groups were performed using statistical analysis, with significance set at p < 0.05.
Results
The average reading level consensus was lower for ChatGPT (10.21 ± 3.22) than Gemini (11.87 ± 2.24), although not statistically significant (p = 0.232). Gemini demonstrated significantly better readability in several indices, including higher FRE scores (52.41 ± 3.32 vs 40.64 ± 4.64, p < 0.001) and lower Gunning Fog (10.42 ± 1.44 vs 13.20 ± 1.84, p < 0.001) and Coleman–Liau Index scores (11.24 ± 1.44 vs 13.84 ± 1.26, p < 0.001). No significant differences were observed in FKGL, SMOG, ARI, or FORCAST scores.
Conclusion
Both AI platforms generated CVD educational materials above the recommended readability level for patient education. Although Gemini showed better readability across several metrics, neither platform consistently met recommended standards. These findings highlight the need for optimizing AI-generated health information to improve accessibility and patient comprehension.
Zitieren
APA
Okudan, R. N. (2026). Comparative Analysis of Readability in AI-Generated Cerebrovascular Disease Patient Education Materials: ChatGPT vs Gemini. Acta Medica Young Doctors, 2(3). https://doi.org/10.66288/actamedi.2026.85
Vancouver
Okudan RN. Comparative Analysis of Readability in AI-Generated Cerebrovascular Disease Patient Education Materials: ChatGPT vs Gemini. Acta Medica Young Doctors. 2026;2(3). doi:10.66288/actamedi.2026.85
BibTeX
@article{Okudan2026,
author = {Okudan, Remziye Nur},
title = {Comparative Analysis of Readability in AI-Generated Cerebrovascular Disease Patient Education Materials: ChatGPT vs Gemini},
journal = {Acta Medica Young Doctors},
year = {2026},
volume = {2},
number = {3},
doi = {10.66288/actamedi.2026.85}
}
EUVIMED