Disparate Performance of Audiologists and Whisper Artificial Intelligence in Recognizing Korean Consonant-Vowel Syllables Produced by Elderly Hearing Loss
Audiology and Speech Research · 30.04.2026 · 22 (2) · 93-99
DOI: 10.21848/asr.260227 ↗Kurz gefasst
Fachartikel in der Zeitschrift Audiology and Speech Research, erschienen am 30.04.2026. Verfasst von Woojae Han und 3 weiteren Autor:innen. Die Arbeit nennt 15 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Ministry of Education, National Research Foundation of Korea.
Abstract (Originalsprache)
This study aimed to evaluate the accuracy of the multilingual automatic speech recognition (ASR) model Whisper large-v3 (OpenAI, San Francisco, CA, USA) in recognizing isolated Korean monosyllables (consonant-vowel and consonant-vowel-consonant structures) produced by two older adults with sensorineural hearing loss, using expert audiologists as the perceptual reference standard. Two older Korean adults (87-year-old male, 78-year-old female) each produced 130 Korean monosyllables. Four audiologists independently transcribed the tokens under blinded conditions. The same audio files were processed using Whisper large-v3 (OpenAI) in an offline environment with Korean language settings. Phoneme-level accuracy, inter-rater agreement, and error patterns were compared across raters, speakers, and phoneme categories. Audiologist transcription showed moderate agreement (mean accuracy: 59.7% for S-001 and 61.7% for S-002; perfect agreement: 55.4% and 62.0%, respectively), reflecting variability in elderly speech perception. In contrast, Whisper demonstrated substantially lower accuracy (13.1% and 13.8%), with high error rates. Errors were primarily observed in specific phoneme categories, including tense consonants, fricatives, liquids, and mid-front vowels, whereas nasals and high vowels were relatively preserved. Whisper did not achieve higher transcription accuracy than audiologists for any monosyllable tested. Whisper large-v3 (OpenAI) shows substantially lower performance than human audiologists in phoneme-level transcription of Korean monosyllables produced by older adults with sensorineural hearing loss. These findings suggest that general-purpose ASR systems have limited clinical applicability in this population and should currently be considered as assistive tools rather than replacements for expert evaluation. Further development, including elderly- and Korean-specific model adaptation, is required.
Förderung
- Ministry of Education
- National Research Foundation of Korea
Zitieren
APA
Han, W., Kim, G., Joo, J., & Ha, S. (2026). Disparate Performance of Audiologists and Whisper Artificial Intelligence in Recognizing Korean Consonant-Vowel Syllables Produced by Elderly Hearing Loss. Audiology and Speech Research, 22(2), 93-99. https://doi.org/10.21848/asr.260227
Vancouver
Han W, Kim G, Joo J, Ha S. Disparate Performance of Audiologists and Whisper Artificial Intelligence in Recognizing Korean Consonant-Vowel Syllables Produced by Elderly Hearing Loss. Audiology and Speech Research. 2026;22(2):93-99. doi:10.21848/asr.260227
BibTeX
@article{Han2026,
author = {Han, Woojae and Kim, Gibbeum and Joo, Jieun and Ha, Seunghee},
title = {Disparate Performance of Audiologists and Whisper Artificial Intelligence in Recognizing Korean Consonant-Vowel Syllables Produced by Elderly Hearing Loss},
journal = {Audiology and Speech Research},
year = {2026},
volume = {22},
number = {2},
pages = {93--99},
doi = {10.21848/asr.260227}
}
EUVIMED