Whisper automatic speech recognition and humans are similarly sensitive to accents but use sentence context differently
The Journal of the Acoustical Society of America · 01.10.2026 · 160 (4) · 3477-3487
DOI: 10.1121/10.0046916 ↗Kurz gefasst
Vergleichsstudie in der Zeitschrift The Journal of the Acoustical Society of America, online erschienen am 26.10.2026. Verfasst von Junrong Chen und 3 weiteren Autor:innen. Beteiligte Einrichtung: Cognitive Science, University of California, San Diego, La Jolla, California 92093, USA. Hauptthemen laut MEDLINE: Speech Perception, Recognition, Psychology, Speech Acoustics. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.
Abstract (Originalsprache)
Despite advancements in speech recognition technology, questions remain about model generalizability and how many models mirror human recognition. These questions are addressed by comparing OpenAI's Whisper model and 75 human transcribers on 300 English sentences (20 speakers, half female, half male, half US-accented, half Spanish-accented). Sentences ended in 100 target words, each occurring in one sensical sentence (The monkey ate the banana), one nonsensical (The monkey ate the shark), and one nonsensical + nonword (The runkey ate the shark). Target word transcription accuracy was examined both in sentences and in isolation (recordings excised from same sentences). Human transcriptions replicated existing work. There were two major findings. First, the model transcribed Spanish-accented speech less well, and it benefited from sensical contexts, particularly for Spanish-accented speech. Second, sentence context affected models differently than humans: Humans benefited only from sensical sentences (with final words in-sentence more accurate than in isolation), while Whisper benefited from any sentence context. Humans and Whisper showed similar patterns of talker difficulty but different error patterns on isolated words, possibly due to Whisper's word-prediction model being overly restrictive in short utterances. Suggestions for ASR development and the possible practical and scientific contributions of automatic speech recognition to understanding human accent processing are discussed.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Cognitive Science, University of California, San Diego, La Jolla, California 92093, USA.
ORCID-Profile: Junrong Chen, Sarah C Creel
Förderung
- National Science Foundation
Zitieren
APA
Chen, J., Kwong, J., Paull, S., & Creel, S. C. (2026). Whisper automatic speech recognition and humans are similarly sensitive to accents but use sentence context differently. The Journal of the Acoustical Society of America, 160(4), 3477-3487. https://doi.org/10.1121/10.0046916
Vancouver
Chen J, Kwong J, Paull S, Creel SC. Whisper automatic speech recognition and humans are similarly sensitive to accents but use sentence context differently. The Journal of the Acoustical Society of America. 2026;160(4):3477-3487. doi:10.1121/10.0046916
BibTeX
@article{Chen2026,
author = {Chen, Junrong and Kwong, Jan and Paull, Sarah and Creel, Sarah C},
title = {Whisper automatic speech recognition and humans are similarly sensitive to accents but use sentence context differently},
journal = {The Journal of the Acoustical Society of America},
year = {2026},
volume = {160},
number = {4},
pages = {3477--3487},
doi = {10.1121/10.0046916}
}
EUVIMED