EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Large Language Models in Patient Education: A Comparative Readability Analysis of Testicular Torsion Information Generated by ChatGPT-5 and Gemini 2.5 Pro

Volkan Çelebi

Acta Medica Young Doctors · 08.07.2026 · 2 (4)

DOI: 10.66288/actamedi.2026.92 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Acta Medica Young Doctors, online erschienen am 08.07.2026. Verfasst von Volkan Çelebi. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background:Large language models (LLMs) are increasingly used to provide patients with health-related information. Although these systems have shown considerable potential in medical communication, the readability of AI-generated patient education materials remains an important concern, particularly for time-sensitive conditions such as testicular torsion, where delayed recognition and treatment may lead to irreversible testicular damage. Objective:This study aimed to compare the readability of patient education materials on testicular torsion generated by ChatGPT-5 and Gemini 2.5 Pro using validated readability assessment tools.

Methods

A cross-sectional comparative study was conducted using standardized prompts submitted to ChatGPT-5 and Gemini 2.5 Pro. Forty patient information texts generated by each model (80 texts in total) were analyzed. Readability was evaluated using the Flesch Reading Ease Score (FRES), Flesch–Kincaid Grade Level (FKGL), Gunning Fog Index, Automated Readability Index (ARI), SMOG Index, Coleman–Liau Index, Dale–Chall Readability Score, Linsear Write Formula, and Spache Readability Formula. Statistical comparisons between groups were performed using independent samples t-tests or Mann–Whitney U tests, with statistical significance defined as p< 0.05.

Results

ChatGPT-5 generated significantly higher FRES values than Gemini 2.5 Pro (62.48 ± 3.84 vs. 45.44 ± 1.52, *p* < 0.001), indicating greater reading ease. Conversely, Gemini 2.5 Pro achieved significantly lower FKGL scores (6.46 ± 2.44 vs. 9.42 ± 1.48, *p* < 0.001), suggesting that its texts corresponded more closely to the sixth-grade reading level recommended for patient education. No statistically significant differences were observed for the ARI, Gunning Fog Index, Coleman–Liau Index, SMOG Index, Linsear Write Formula, Dale–Chall Readability Score, or Spache Readability Formula (all *p* > 0.05).

Conclusion

ChatGPT-5 and Gemini 2.5 Pro produced patient education materials with broadly comparable overall readability. ChatGPT-5 generated texts that were easier to read according to the FRES, whereas Gemini 2.5 Pro produced materials requiring a lower educational grade level according to the FKGL. Despite these differences, neither model consistently achieved the readability standards recommended for patient education. AI-generated educational materials should therefore undergo expert review before clinical use, particularly for emergency conditions such as testicular torsion.

Zitieren

APA

Çelebi, V. (2026). Large Language Models in Patient Education: A Comparative Readability Analysis of Testicular Torsion Information Generated by ChatGPT-5 and Gemini 2.5 Pro. Acta Medica Young Doctors, 2(4). https://doi.org/10.66288/actamedi.2026.92

Vancouver

Çelebi V. Large Language Models in Patient Education: A Comparative Readability Analysis of Testicular Torsion Information Generated by ChatGPT-5 and Gemini 2.5 Pro. Acta Medica Young Doctors. 2026;2(4). doi:10.66288/actamedi.2026.92

BibTeX
@article{elebi2026,
  author = {Çelebi, Volkan},
  title = {Large Language Models in Patient Education: A Comparative Readability Analysis of Testicular Torsion Information Generated by ChatGPT-5 and Gemini 2.5 Pro},
  journal = {Acta Medica Young Doctors},
  year = {2026},
  volume = {2},
  number = {4},
  doi = {10.66288/actamedi.2026.92}
}
Kostenlos starten →