The Use of Artificial Intelligence to Improve Readability of Otolaryngology Patient Education Materials
Otolaryngology–Head and Neck Surgery · 2024-08 · 171 (2) · 603-608
DOI: 10.1002/ohn.816 ↗At a glance
Journal article in Otolaryngology–Head and Neck Surgery, published online on 2024-05-15. Written by Evan A Patel and 7 co-authors. Institution: Department of Otorhinolaryngology-Head and Neck Surgery, Rush University Medical Center, Chicago, Illinois, USA. Major MEDLINE topics: Artificial Intelligence, Otolaryngology, Patient Education as Topic, Comprehension. Cited 45 times so far (Crossref); 26 references.
Topics: Künstliche Intelligenz in der Pflege, Selbstmanagement bei chronischen Erkrankungen
Abstract (original language)
Objective
The recommended readability of health education materials is at the sixth‐grade level. Artificial intelligence (AI) large language models such as the newly released ChatGPT4 might facilitate the conversion of patient‐education materials at scale. We sought to ascertain whether online otolaryngology education materials meet recommended reading levels and whether ChatGPT4 could rewrite these materials to the sixth‐grade level. We also wished to ensure that converted materials were accurate and retained sufficient content.
Methods
Seventy‐one articles from patient educational materials published online by the American Academy of Otolaryngology–Head and Neck Surgery were selected. Articles were entered into ChatGPT4 with the prompt “translate this text to a sixth‐grade reading level.” Flesch Reading Ease Score (FRES) and Flesch‐Kincaid Grade Level (FKGL) were determined for each article before and after AI conversion. Each article and conversion were reviewed for factual inaccuracies, and each conversion was reviewed for content retention.
Results
The 71 articles had an initial average FKGL of 11.03 and FRES of 46.79. After conversion by ChatGPT4, the average FKGL across all articles was 5.80 and FRES was 77.27. Converted materials provided enough detail for patient education with no factual errors.
Discussion
We found that ChatGPT4 improved the reading accessibility of otolaryngology online patient education materials to recommended levels quickly and effectively.
Implications for Practice
Physicians can determine whether their patient education materials exceed current recommended reading levels by using widely available measurement tools, and then apply AI dialogue platforms to modify materials to more accessible levels as needed. Level of Evidence Level 5.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Otorhinolaryngology-Head and Neck Surgery, Rush University Medical Center, Chicago, Illinois, USA.
ORCID profiles: Evan A Patel
Cite
APA
Patel, E. A., Fleischer, L., Filip, P., Eggerstedt, M., Hutz, M., Michaelides, E., Batra, P. S., & Tajudeen, B. A. (2024). The Use of Artificial Intelligence to Improve Readability of Otolaryngology Patient Education Materials. Otolaryngology–Head and Neck Surgery, 171(2), 603-608. https://doi.org/10.1002/ohn.816
Vancouver
Patel EA, Fleischer L, Filip P, Eggerstedt M, Hutz M, Michaelides E, et al. The Use of Artificial Intelligence to Improve Readability of Otolaryngology Patient Education Materials. Otolaryngology–Head and Neck Surgery. 2024;171(2):603-608. doi:10.1002/ohn.816
BibTeX
@article{Patel2024,
author = {Patel, Evan A and Fleischer, Lindsay and Filip, Peter and Eggerstedt, Michael and Hutz, Michael and Michaelides, Elias and Batra, Pete S and Tajudeen, Bobby A},
title = {The Use of Artificial Intelligence to Improve Readability of Otolaryngology Patient Education Materials},
journal = {Otolaryngology–Head and Neck Surgery},
year = {2024},
volume = {171},
number = {2},
pages = {603--608},
doi = {10.1002/ohn.816}
}
EUVIMED