Enhancing Multilingual Patient Education: ChatGPT's Accuracy and Readability for SSNHL Queries in English and Spanish
OTO Open · 2024-10 · 8 (4)
DOI: 10.1002/oto2.70048 ↗Kurz gefasst
Fachartikel in der Zeitschrift OTO Open, online erschienen am 11.12.2024. Verfasst von Emily Ajit-Roger und 4 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Medicine and Health Sciences McGill University Montreal Quebec Canada. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Themen: Selbstmanagement bei chronischen Erkrankungen, Künstliche Intelligenz in der Pflege
Abstract (Originalsprache)
Objective
This study investigates ChatGPT's accuracy, readability, understandability, and actionability in responding to patient queries on sudden sensorineural hearing loss (SSNHL) in English and Spanish, when compared to Google responses. The objective is to address concerns regarding its proficiency in addressing medical inquiries when presented in a language divergent from its primary programming. Study Design Observational.
Setting
Virtual environment.
Methods
Using ChatGPT 3.5 and Google, questions from the AAO‐HNSF guidelines were presented in English and Spanish. Responses were graded by 2 otolaryngologists proficient in both languages using a 4‐point Likert scale and the PEMAT‐P tool. To ensure uniform application of the Likert scale, a third independent evaluator reviewed the consistency in grading. Readability was evaluated using 3 different tools specific to each language. IBM SPSS Version 29 was used for statistical analysis using one‐way analysis of variance.
Results
Across both languages, the responses displayed a native‐level language proficiency. Accuracy was comparable between sources and languages. Google's Spanish responses had better readability (effect size 0.35, P < .001), while Google's English responses were more understandable (effect size 0.67, P = .018). ChatGPT's English responses demonstrated the highest level of actionability (60%), though not significantly different when compared to other sources (effect size 0.47, P = .14).
Conclusion
ChatGPT offers patients comprehensive and guideline‐conforming answers to SSNHL patient medical queries in the 2 most spoken languages in the United States. However, improvements in its readability and understandability are warranted for more accessible patient education.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Medicine and Health Sciences McGill University Montreal Quebec Canada.
- Department of Otolaryngology-Head and Neck Surgery McGill University Montreal Quebec Canada.
- Department of Pediatric Otolaryngology Montreal Children's Hospital Montreal Quebec Canada.
ORCID-Profile: Emily Ajit-Roger, Alexander Moise
Zitieren
APA
Ajit-Roger, E., Moise, A., Peralta, C., Orishchak, O., & Daniel, S. J. (2024). Enhancing Multilingual Patient Education: ChatGPT's Accuracy and Readability for SSNHL Queries in English and Spanish. OTO Open, 8(4). https://doi.org/10.1002/oto2.70048
Vancouver
Ajit-Roger E, Moise A, Peralta C, Orishchak O, Daniel SJ. Enhancing Multilingual Patient Education: ChatGPT's Accuracy and Readability for SSNHL Queries in English and Spanish. OTO Open. 2024;8(4). doi:10.1002/oto2.70048
BibTeX
@article{AjitRoger2024,
author = {Ajit-Roger, Emily and Moise, Alexander and Peralta, Carolina and Orishchak, Ostap and Daniel, Sam J},
title = {Enhancing Multilingual Patient Education: ChatGPT's Accuracy and Readability for SSNHL Queries in English and Spanish},
journal = {OTO Open},
year = {2024},
volume = {8},
number = {4},
doi = {10.1002/oto2.70048}
}
EUVIMED