EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Comparative Analysis of Readability in AI-Generated Cerebrovascular Disease Patient Education Materials: ChatGPT vs Gemini

Remziye Nur Okudan

Acta Medica Young Doctors · 01.05.2026 · 2 (3)

DOI: 10.66288/actamedi.2026.85 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Acta Medica Young Doctors, online erschienen am 01.05.2026. Verfasst von Remziye Nur Okudan. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Cerebrovascular disease (CVD) is a leading cause of mortality and disability worldwide. Patient education plays a critical role in disease management; however, the effectiveness of such materials depends heavily on their readability. Artificial intelligence (AI) tools, such as ChatGPT and Gemini, are increasingly used to generate health information, yet their readability remains uncertain.

Objective

This study aimed to evaluate and compare the readability of CVD-related patient education materials generated by ChatGPT and Gemini using multiple validated readability indices.

Methods

A total of 40 educational texts on cerebrovascular disease were generated, with 20 texts produced by each AI platform using standardized prompts. Readability was assessed using the Automated Readability Index (ARI), Flesch Reading Ease (FRE), Flesch-Kincaid Grade Level (FKGL), Gunning Fog Scale, Coleman–Liau Index, SMOG index, Linsear Write Formula, and FORCAST readability formula. Mean values and standard deviations were calculated, and comparisons between groups were performed using statistical analysis, with significance set at p < 0.05.

Results

The average reading level consensus was lower for ChatGPT (10.21 ± 3.22) than Gemini (11.87 ± 2.24), although not statistically significant (p = 0.232). Gemini demonstrated significantly better readability in several indices, including higher FRE scores (52.41 ± 3.32 vs 40.64 ± 4.64, p < 0.001) and lower Gunning Fog (10.42 ± 1.44 vs 13.20 ± 1.84, p < 0.001) and Coleman–Liau Index scores (11.24 ± 1.44 vs 13.84 ± 1.26, p < 0.001). No significant differences were observed in FKGL, SMOG, ARI, or FORCAST scores.

Conclusion

Both AI platforms generated CVD educational materials above the recommended readability level for patient education. Although Gemini showed better readability across several metrics, neither platform consistently met recommended standards. These findings highlight the need for optimizing AI-generated health information to improve accessibility and patient comprehension.

Zitieren

APA

Okudan, R. N. (2026). Comparative Analysis of Readability in AI-Generated Cerebrovascular Disease Patient Education Materials: ChatGPT vs Gemini. Acta Medica Young Doctors, 2(3). https://doi.org/10.66288/actamedi.2026.85

Vancouver

Okudan RN. Comparative Analysis of Readability in AI-Generated Cerebrovascular Disease Patient Education Materials: ChatGPT vs Gemini. Acta Medica Young Doctors. 2026;2(3). doi:10.66288/actamedi.2026.85

BibTeX
@article{Okudan2026,
  author = {Okudan, Remziye Nur},
  title = {Comparative Analysis of Readability in AI-Generated Cerebrovascular Disease Patient Education Materials: ChatGPT vs Gemini},
  journal = {Acta Medica Young Doctors},
  year = {2026},
  volume = {2},
  number = {3},
  doi = {10.66288/actamedi.2026.85}
}
Kostenlos starten →