EUVIMEDEUVIMED entdecken
Vergleichsstudie

Assessing the Quality and Readability of Online Patient Information: ENT UK Patient Information e-Leaflets versus Responses by a Generative Artificial Intelligence

Eamon Shamil iD, Tsz Ki Ko, Ka Siu Fan iD, James Schuster-Bruce, Mustafa Jaafar, Sadie Khwaja, Nicholas Eynon-Lewis, Alwyn D'Souza, Peter Andrews

Facial Plastic Surgery · 01.08.2025 · 41 (04) · 472-481

DOI: 10.1055/a-2413-3675 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Facial Plastic Surgery, erschienen am 01.08.2025. Verfasst von Eamon Shamil und 8 weiteren Autor:innen. Beteiligte Einrichtung: The Royal National ENT Hospital, University College London Hospitals NHS Foundation Trust, London, England, United Kingdom. Hauptthemen laut MEDLINE: Comprehension, Artificial Intelligence, Patient Education as Topic, Internet. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 36 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The evolution of artificial intelligence has introduced new ways to disseminate health information, including natural language processing models like ChatGPT. However, the quality and readability of such digitally generated information remains understudied. This study is the first to compare the quality and readability of digitally generated health information against leaflets produced by professionals. Methodology Patient information leaflets from five ENT UK leaflets and their corresponding ChatGPT responses were extracted from the Internet. Assessors with various degrees of medical knowledge evaluated the content using the Ensuring Quality Information for Patients (EQIP) tool and readability tools including the Flesch-Kincaid Grade Level (FKGL). Statistical analysis was performed to identify differences between leaflets, assessors, and sources of information.

Results

ENT UK leaflets were of moderate quality, scoring a median EQIP of 23. Statistically significant differences in overall EQIP score were identified between ENT UK leaflets, but ChatGPT responses were of uniform quality. Nonspecialist doctors rated the highest EQIP scores, while medical students scored the lowest. The mean readability of ENT UK leaflets was higher than ChatGPT responses. The information metrics of ENT UK leaflets were moderate and varied between topics. Equivalent ChatGPT information provided comparable content quality, but with reduced readability.

Conclusion

ChatGPT patient information and professionally produced leaflets had comparable content, but large language model content required a higher reading age. With the increasing use of online health resources, this study highlights the need for a balanced approach that considers both the quality and readability of patient education materials.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ComprehensionArtificial IntelligencePatient Education as TopicInternetOtolaryngologyConsumer Health InformationPamphletsHumansUnited KingdomGenerative Artificial Intelligence

Autor:innen und Institutionen

  • The Royal National ENT Hospital, University College London Hospitals NHS Foundation Trust, London, England, United Kingdom.
  • Royal Stoke University Hospital, United Kingdom.
  • Royal Surrey County Hospital, Guildford, Surrey, United Kingdom.
  • Department of ENT, Kings College Hospital Foundation Trust, London, England, United Kingdom.
  • UCL Artificial Intelligence Centre for Doctoral Training, London, England, United Kingdom.
  • Department of ENT, Manchester University NHS Foundation Trust, England, United Kingdom.

ORCID-Profile: Eamon Shamil, Ka Siu Fan

Zitieren

APA

Shamil, E., Ko, T. K., Fan, K. S., Schuster-Bruce, J., Jaafar, M., Khwaja, S., Eynon-Lewis, N., D'Souza, A., & Andrews, P. (2025). Assessing the Quality and Readability of Online Patient Information: ENT UK Patient Information e-Leaflets versus Responses by a Generative Artificial Intelligence. Facial Plastic Surgery, 41(04), 472-481. https://doi.org/10.1055/a-2413-3675

Vancouver

Shamil E, Ko TK, Fan KS, Schuster-Bruce J, Jaafar M, Khwaja S, et al. Assessing the Quality and Readability of Online Patient Information: ENT UK Patient Information e-Leaflets versus Responses by a Generative Artificial Intelligence. Facial Plastic Surgery. 2025;41(04):472-481. doi:10.1055/a-2413-3675

BibTeX
@article{Shamil2025,
  author = {Shamil, Eamon and Ko, Tsz Ki and Fan, Ka Siu and Schuster-Bruce, James and Jaafar, Mustafa and Khwaja, Sadie and Eynon-Lewis, Nicholas and D'Souza, Alwyn and Andrews, Peter},
  title = {Assessing the Quality and Readability of Online Patient Information: ENT UK Patient Information e-Leaflets versus Responses by a Generative Artificial Intelligence},
  journal = {Facial Plastic Surgery},
  year = {2025},
  volume = {41},
  number = {04},
  pages = {472--481},
  doi = {10.1055/a-2413-3675}
}
Kostenlos starten →