EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY 4.0

Whisper automatic speech recognition and humans are similarly sensitive to accents but use sentence context differently

Junrong Chen iD, Jan Kwong, Sarah Paull, Sarah C Creel iD

The Journal of the Acoustical Society of America · 01.10.2026 · 160 (4) · 3477-3487

DOI: 10.1121/10.0046916 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift The Journal of the Acoustical Society of America, online erschienen am 26.10.2026. Verfasst von Junrong Chen und 3 weiteren Autor:innen. Beteiligte Einrichtung: Cognitive Science, University of California, San Diego, La Jolla, California 92093, USA. Hauptthemen laut MEDLINE: Speech Perception, Recognition, Psychology, Speech Acoustics. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Despite advancements in speech recognition technology, questions remain about model generalizability and how many models mirror human recognition. These questions are addressed by comparing OpenAI's Whisper model and 75 human transcribers on 300 English sentences (20 speakers, half female, half male, half US-accented, half Spanish-accented). Sentences ended in 100 target words, each occurring in one sensical sentence (The monkey ate the banana), one nonsensical (The monkey ate the shark), and one nonsensical + nonword (The runkey ate the shark). Target word transcription accuracy was examined both in sentences and in isolation (recordings excised from same sentences). Human transcriptions replicated existing work. There were two major findings. First, the model transcribed Spanish-accented speech less well, and it benefited from sensical contexts, particularly for Spanish-accented speech. Second, sentence context affected models differently than humans: Humans benefited only from sensical sentences (with final words in-sentence more accurate than in isolation), while Whisper benefited from any sentence context. Humans and Whisper showed similar patterns of talker difficulty but different error patterns on isolated words, possibly due to Whisper's word-prediction model being overly restrictive in short utterances. Suggestions for ASR development and the possible practical and scientific contributions of automatic speech recognition to understanding human accent processing are discussed.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Speech PerceptionRecognition, PsychologySpeech AcousticsHumansFemaleMaleAdultLanguageYoung Adult

Autor:innen und Institutionen

  • Cognitive Science, University of California, San Diego, La Jolla, California 92093, USA.

ORCID-Profile: Junrong Chen, Sarah C Creel

Förderung

  • National Science Foundation

Zitieren

APA

Chen, J., Kwong, J., Paull, S., & Creel, S. C. (2026). Whisper automatic speech recognition and humans are similarly sensitive to accents but use sentence context differently. The Journal of the Acoustical Society of America, 160(4), 3477-3487. https://doi.org/10.1121/10.0046916

Vancouver

Chen J, Kwong J, Paull S, Creel SC. Whisper automatic speech recognition and humans are similarly sensitive to accents but use sentence context differently. The Journal of the Acoustical Society of America. 2026;160(4):3477-3487. doi:10.1121/10.0046916

BibTeX
@article{Chen2026,
  author = {Chen, Junrong and Kwong, Jan and Paull, Sarah and Creel, Sarah C},
  title = {Whisper automatic speech recognition and humans are similarly sensitive to accents but use sentence context differently},
  journal = {The Journal of the Acoustical Society of America},
  year = {2026},
  volume = {160},
  number = {4},
  pages = {3477--3487},
  doi = {10.1121/10.0046916}
}
Kostenlos starten →