Large Language Models in Patient Education: A Comparative Readability Analysis of Testicular Torsion Information Generated by ChatGPT-5 and Gemini 2.5 Pro
Acta Medica Young Doctors · 08.07.2026 · 2 (4)
DOI: 10.66288/actamedi.2026.92 ↗Kurz gefasst
Fachartikel in der Zeitschrift Acta Medica Young Doctors, online erschienen am 08.07.2026. Verfasst von Volkan Çelebi. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Themen: Selbstmanagement bei chronischen Erkrankungen, Künstliche Intelligenz in der Pflege
Abstract (Originalsprache)
Background:Large language models (LLMs) are increasingly used to provide patients with health-related information. Although these systems have shown considerable potential in medical communication, the readability of AI-generated patient education materials remains an important concern, particularly for time-sensitive conditions such as testicular torsion, where delayed recognition and treatment may lead to irreversible testicular damage. Objective:This study aimed to compare the readability of patient education materials on testicular torsion generated by ChatGPT-5 and Gemini 2.5 Pro using validated readability assessment tools.
Methods
A cross-sectional comparative study was conducted using standardized prompts submitted to ChatGPT-5 and Gemini 2.5 Pro. Forty patient information texts generated by each model (80 texts in total) were analyzed. Readability was evaluated using the Flesch Reading Ease Score (FRES), Flesch–Kincaid Grade Level (FKGL), Gunning Fog Index, Automated Readability Index (ARI), SMOG Index, Coleman–Liau Index, Dale–Chall Readability Score, Linsear Write Formula, and Spache Readability Formula. Statistical comparisons between groups were performed using independent samples t-tests or Mann–Whitney U tests, with statistical significance defined as p< 0.05.
Results
ChatGPT-5 generated significantly higher FRES values than Gemini 2.5 Pro (62.48 ± 3.84 vs. 45.44 ± 1.52, *p* < 0.001), indicating greater reading ease. Conversely, Gemini 2.5 Pro achieved significantly lower FKGL scores (6.46 ± 2.44 vs. 9.42 ± 1.48, *p* < 0.001), suggesting that its texts corresponded more closely to the sixth-grade reading level recommended for patient education. No statistically significant differences were observed for the ARI, Gunning Fog Index, Coleman–Liau Index, SMOG Index, Linsear Write Formula, Dale–Chall Readability Score, or Spache Readability Formula (all *p* > 0.05).
Conclusion
ChatGPT-5 and Gemini 2.5 Pro produced patient education materials with broadly comparable overall readability. ChatGPT-5 generated texts that were easier to read according to the FRES, whereas Gemini 2.5 Pro produced materials requiring a lower educational grade level according to the FKGL. Despite these differences, neither model consistently achieved the readability standards recommended for patient education. AI-generated educational materials should therefore undergo expert review before clinical use, particularly for emergency conditions such as testicular torsion.
Zitieren
APA
Çelebi, V. (2026). Large Language Models in Patient Education: A Comparative Readability Analysis of Testicular Torsion Information Generated by ChatGPT-5 and Gemini 2.5 Pro. Acta Medica Young Doctors, 2(4). https://doi.org/10.66288/actamedi.2026.92
Vancouver
Çelebi V. Large Language Models in Patient Education: A Comparative Readability Analysis of Testicular Torsion Information Generated by ChatGPT-5 and Gemini 2.5 Pro. Acta Medica Young Doctors. 2026;2(4). doi:10.66288/actamedi.2026.92
BibTeX
@article{elebi2026,
author = {Çelebi, Volkan},
title = {Large Language Models in Patient Education: A Comparative Readability Analysis of Testicular Torsion Information Generated by ChatGPT-5 and Gemini 2.5 Pro},
journal = {Acta Medica Young Doctors},
year = {2026},
volume = {2},
number = {4},
doi = {10.66288/actamedi.2026.92}
}
EUVIMED