EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Enhancing Multilingual Patient Education: ChatGPT's Accuracy and Readability for SSNHL Queries in English and Spanish

Emily Ajit-Roger iD, Alexander Moise iD, Carolina Peralta, Ostap Orishchak, Sam J Daniel

OTO Open · 2024-10 · 8 (4)

DOI: 10.1002/oto2.70048 ↗

Kurz gefasst

Fachartikel in der Zeitschrift OTO Open, online erschienen am 11.12.2024. Verfasst von Emily Ajit-Roger und 4 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Medicine and Health Sciences McGill University Montreal Quebec Canada. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

This study investigates ChatGPT's accuracy, readability, understandability, and actionability in responding to patient queries on sudden sensorineural hearing loss (SSNHL) in English and Spanish, when compared to Google responses. The objective is to address concerns regarding its proficiency in addressing medical inquiries when presented in a language divergent from its primary programming. Study Design Observational.

Setting

Virtual environment.

Methods

Using ChatGPT 3.5 and Google, questions from the AAO‐HNSF guidelines were presented in English and Spanish. Responses were graded by 2 otolaryngologists proficient in both languages using a 4‐point Likert scale and the PEMAT‐P tool. To ensure uniform application of the Likert scale, a third independent evaluator reviewed the consistency in grading. Readability was evaluated using 3 different tools specific to each language. IBM SPSS Version 29 was used for statistical analysis using one‐way analysis of variance.

Results

Across both languages, the responses displayed a native‐level language proficiency. Accuracy was comparable between sources and languages. Google's Spanish responses had better readability (effect size 0.35, P < .001), while Google's English responses were more understandable (effect size 0.67, P = .018). ChatGPT's English responses demonstrated the highest level of actionability (60%), though not significantly different when compared to other sources (effect size 0.47, P = .14).

Conclusion

ChatGPT offers patients comprehensive and guideline‐conforming answers to SSNHL patient medical queries in the 2 most spoken languages in the United States. However, improvements in its readability and understandability are warranted for more accessible patient education.

Schlagwörter

Stichwörter der Autor:innen

Spanishartificial intelligencehealth educationlarge language modelsudden sensorineural hearing loss

Autor:innen und Institutionen

  • Faculty of Medicine and Health Sciences McGill University Montreal Quebec Canada.
  • Department of Otolaryngology-Head and Neck Surgery McGill University Montreal Quebec Canada.
  • Department of Pediatric Otolaryngology Montreal Children's Hospital Montreal Quebec Canada.

ORCID-Profile: Emily Ajit-Roger, Alexander Moise

Zitieren

APA

Ajit-Roger, E., Moise, A., Peralta, C., Orishchak, O., & Daniel, S. J. (2024). Enhancing Multilingual Patient Education: ChatGPT's Accuracy and Readability for SSNHL Queries in English and Spanish. OTO Open, 8(4). https://doi.org/10.1002/oto2.70048

Vancouver

Ajit-Roger E, Moise A, Peralta C, Orishchak O, Daniel SJ. Enhancing Multilingual Patient Education: ChatGPT's Accuracy and Readability for SSNHL Queries in English and Spanish. OTO Open. 2024;8(4). doi:10.1002/oto2.70048

BibTeX
@article{AjitRoger2024,
  author = {Ajit-Roger, Emily and Moise, Alexander and Peralta, Carolina and Orishchak, Ostap and Daniel, Sam J},
  title = {Enhancing Multilingual Patient Education: ChatGPT's Accuracy and Readability for SSNHL Queries in English and Spanish},
  journal = {OTO Open},
  year = {2024},
  volume = {8},
  number = {4},
  doi = {10.1002/oto2.70048}
}
Kostenlos starten →