EUVIMEDEUVIMED entdecken
Crossref

Assessing the efficacy of word error rate as a proxy for pronunciation quality

Yongkook Won

Journal of Second Language Pronunciation · 01.12.2025 · 11 (3) · 394-422

DOI: 10.1075/jslp.25012.won ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Second Language Pronunciation, online erschienen am 07.07.2025. Verfasst von Yongkook Won. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 72 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study examines the validity of WER as a proxy for pronunciation quality in EFL contexts. Human ratings of comprehensibility and accentedness were compared with WER and automated pronunciation scores from six ASR systems — Kaldi, wav2vec 2.0, HuBERT, Whisper (Base and Large-v3), and Microsoft Azure — using 190 read-aloud recordings by Korean elementary learners. With respect to pronunciation scoring, Azure’s phoneme-level accuracy scores demonstrated moderate correlations with human judgments, while Kaldi’s GOP scores showed no meaningful association. Analysis of WER revealed a critical trade-off between ASR accuracy and perceptual sensitivity: high-performing systems such as Whisper Large-v3 and Azure produced near-zero WERs but weakly correlated with human ratings. In contrast, mid-performing systems such as Whisper Base and HuBERT showed stronger correlations, indicating that moderate WER values may better reflect pronunciation variation. These results underscore the limitations of WER in advanced ASR systems and the need for perceptually grounded, interpretable metrics.

Zitieren

APA

Won, Y. (2025). Assessing the efficacy of word error rate as a proxy for pronunciation quality. Journal of Second Language Pronunciation, 11(3), 394-422. https://doi.org/10.1075/jslp.25012.won

Vancouver

Won Y. Assessing the efficacy of word error rate as a proxy for pronunciation quality. Journal of Second Language Pronunciation. 2025;11(3):394-422. doi:10.1075/jslp.25012.won

BibTeX
@article{Won2025,
  author = {Won, Yongkook},
  title = {Assessing the efficacy of word error rate as a proxy for pronunciation quality},
  journal = {Journal of Second Language Pronunciation},
  year = {2025},
  volume = {11},
  number = {3},
  pages = {394--422},
  doi = {10.1075/jslp.25012.won}
}
Kostenlos starten →