Utility of ChatGPT-4o in Creating Patient Handouts in Ophthalmology: A Comparison With American Academy of Ophthalmology Educational Materials
Translational Vision Science & Technology · 2026
DOI: 10.1167/tvst.15.2.14 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Translational Vision Science & Technology, 2026. Verfasst von Linda L Wu und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Ophthalmology, Keck School of Medicine at the University of Southern California, Los Angeles, CA, USA. Hauptthemen laut MEDLINE: Ophthalmology, Comprehension, Patient Education as Topic, Teaching Materials. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NEI NIH HHS.
Abstract (Originalsprache)
Purpose
This study compares the readability and quality of ChatGPT-4o-generated and American Academy of Ophthalmology (AAO) patient handouts in English and Spanish, as AAO materials are expert developed but not publicly accessible.
Methods
Ten AAO handouts on common ocular conditions were obtained in English and Spanish. ChatGPT-4o was queried to create handouts at an 8th-grade reading level of comparable length. English readability was assessed with Simple Measure of Gobbledygook (SMOG) and Flesch-Kincaid Reading Ease, and Spanish readability was assessed with five validated metrics, including the Szigriszt-Pazos Perspicuity Index (SPPI) and the Flesch-Szigriszt Index (INFLESZ). Grade levels were measured by the Flesch-Kincaid Grade Level and Crawford-Nivel-de-Grado. Three ophthalmologist graders per language assessed content with the Quality of Generated Language Outputs for Patients (QGLOP), indicated their preferred handout, and attempted to identify its source.
Results
ChatGPT-4o handouts had English readability similar to that of AAO (SMOG 7.86 ± 0.53 vs. 7.49 ± 0.76; P = 0.35) but significantly lower Spanish SPPI scores (60.26 ± 4.47 vs. 64.82 ± 2.97; P = 0.04). Grade levels were comparable. English QGLOP scores were similar (14.73 vs. 14.87; P = 0.97), but Spanish ChatGPT handouts scored higher in all categories (15.83 vs. 14.23; P < 0.001). ChatGPT-4o handouts were correctly identified by 17 of 30 in English (56.7%) and by 3 of 30 in Spanish (10.0%). They were favored 23 out of 30 times in English (76.7%) and 29 out of 30 times in Spanish (96.7%).
Conclusions
ChatGPT-generated materials matched or exceeded AAO handouts in readability and content quality, with Spanish versions being most preferred. Translational Relevance: Integrating artificial intelligence-generated patient education materials into ophthalmic care can enhance health literacy for multilingual patient populations.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Ophthalmology, Keck School of Medicine at the University of Southern California, Los Angeles, CA, USA.
- Roski Eye Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA.
- Ginsburg Institute for Biomedical Therapeutics, University of Southern California, Los Angeles, CA, USA.
- Monterrey Institute of Technology and Higher Education (ITESM), School of Medicine, Monterrey, Mexico.
- University of Costa Rica, San José, Costa Rica.
- Institute of Eye Surgery, San José, Costa Rica.
Förderung
- NEI NIH HHS
Zitieren
APA
Wu, L. L., Hong, A. T., Davuluru, S. S., Moreno-Diaz, E. A., Gutiérrez-Hernández, J. C., Martinez-Camarillo, J. C., Xu, B. Y., & Zhang-Nunes, S. (2026). Utility of ChatGPT-4o in Creating Patient Handouts in Ophthalmology: A Comparison With American Academy of Ophthalmology Educational Materials. Translational Vision Science & Technology. https://doi.org/10.1167/tvst.15.2.14
Vancouver
Wu LL, Hong AT, Davuluru SS, Moreno-Diaz EA, Gutiérrez-Hernández JC, Martinez-Camarillo JC, et al. Utility of ChatGPT-4o in Creating Patient Handouts in Ophthalmology: A Comparison With American Academy of Ophthalmology Educational Materials. Translational Vision Science & Technology. 2026. doi:10.1167/tvst.15.2.14
BibTeX
@article{Wu2026,
author = {Wu, Linda L and Hong, Alexander T and Davuluru, Shaili S and Moreno-Diaz, Edgar Alejandro and Gutiérrez-Hernández, Juan Carlos and Martinez-Camarillo, Juan Carlos and Xu, Benjamin Y and Zhang-Nunes, Sandy},
title = {Utility of ChatGPT-4o in Creating Patient Handouts in Ophthalmology: A Comparison With American Academy of Ophthalmology Educational Materials},
journal = {Translational Vision Science & Technology},
year = {2026},
doi = {10.1167/tvst.15.2.14}
}
EUVIMED