Assessing the Quality and Readability of Online Patient Information: ENT UK Patient Information e-Leaflets versus Responses by a Generative Artificial Intelligence
Facial Plastic Surgery · 01.08.2025 · 41 (04) · 472-481
DOI: 10.1055/a-2413-3675 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift Facial Plastic Surgery, erschienen am 01.08.2025. Verfasst von Eamon Shamil und 8 weiteren Autor:innen. Beteiligte Einrichtung: The Royal National ENT Hospital, University College London Hospitals NHS Foundation Trust, London, England, United Kingdom. Hauptthemen laut MEDLINE: Comprehension, Artificial Intelligence, Patient Education as Topic, Internet. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 36 Literaturangaben.
Abstract (Originalsprache)
Background
The evolution of artificial intelligence has introduced new ways to disseminate health information, including natural language processing models like ChatGPT. However, the quality and readability of such digitally generated information remains understudied. This study is the first to compare the quality and readability of digitally generated health information against leaflets produced by professionals. Methodology Patient information leaflets from five ENT UK leaflets and their corresponding ChatGPT responses were extracted from the Internet. Assessors with various degrees of medical knowledge evaluated the content using the Ensuring Quality Information for Patients (EQIP) tool and readability tools including the Flesch-Kincaid Grade Level (FKGL). Statistical analysis was performed to identify differences between leaflets, assessors, and sources of information.
Results
ENT UK leaflets were of moderate quality, scoring a median EQIP of 23. Statistically significant differences in overall EQIP score were identified between ENT UK leaflets, but ChatGPT responses were of uniform quality. Nonspecialist doctors rated the highest EQIP scores, while medical students scored the lowest. The mean readability of ENT UK leaflets was higher than ChatGPT responses. The information metrics of ENT UK leaflets were moderate and varied between topics. Equivalent ChatGPT information provided comparable content quality, but with reduced readability.
Conclusion
ChatGPT patient information and professionally produced leaflets had comparable content, but large language model content required a higher reading age. With the increasing use of online health resources, this study highlights the need for a balanced approach that considers both the quality and readability of patient education materials.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- The Royal National ENT Hospital, University College London Hospitals NHS Foundation Trust, London, England, United Kingdom.
- Royal Stoke University Hospital, United Kingdom.
- Royal Surrey County Hospital, Guildford, Surrey, United Kingdom.
- Department of ENT, Kings College Hospital Foundation Trust, London, England, United Kingdom.
- UCL Artificial Intelligence Centre for Doctoral Training, London, England, United Kingdom.
- Department of ENT, Manchester University NHS Foundation Trust, England, United Kingdom.
ORCID-Profile: Eamon Shamil, Ka Siu Fan
Zitieren
APA
Shamil, E., Ko, T. K., Fan, K. S., Schuster-Bruce, J., Jaafar, M., Khwaja, S., Eynon-Lewis, N., D'Souza, A., & Andrews, P. (2025). Assessing the Quality and Readability of Online Patient Information: ENT UK Patient Information e-Leaflets versus Responses by a Generative Artificial Intelligence. Facial Plastic Surgery, 41(04), 472-481. https://doi.org/10.1055/a-2413-3675
Vancouver
Shamil E, Ko TK, Fan KS, Schuster-Bruce J, Jaafar M, Khwaja S, et al. Assessing the Quality and Readability of Online Patient Information: ENT UK Patient Information e-Leaflets versus Responses by a Generative Artificial Intelligence. Facial Plastic Surgery. 2025;41(04):472-481. doi:10.1055/a-2413-3675
BibTeX
@article{Shamil2025,
author = {Shamil, Eamon and Ko, Tsz Ki and Fan, Ka Siu and Schuster-Bruce, James and Jaafar, Mustafa and Khwaja, Sadie and Eynon-Lewis, Nicholas and D'Souza, Alwyn and Andrews, Peter},
title = {Assessing the Quality and Readability of Online Patient Information: ENT UK Patient Information e-Leaflets versus Responses by a Generative Artificial Intelligence},
journal = {Facial Plastic Surgery},
year = {2025},
volume = {41},
number = {04},
pages = {472--481},
doi = {10.1055/a-2413-3675}
}
EUVIMED