Developing an Automatic Pronunciation Scorer: Aligning Speech Evaluation Models and Applied Linguistics Constructs
Language Learning · 2025-09 · 75 (S1) · 170-203
DOI: 10.1111/lang.70000 ↗Kurz gefasst
Fachartikel in der Zeitschrift Language Learning, online erschienen am 14.07.2025. Verfasst von Danwei Cai und 5 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Globalization and increases in the numbers of English language learners have led to a growing demand for English proficiency assessments of spoken language. In this paper, we describe the development of an automatic pronunciation scorer built on state‐of‐the‐art deep neural network models. The model is trained on a bespoke human‐rated dataset that reflects current perspectives on pronunciation and intelligibility. The new scorer is evaluated along three criteria: How well it explains expert human ratings, how it compares to other state‐of‐the‐art automatic pronunciation scorers in explaining expert human ratings, and the extent to which it exhibits bias toward different groups of test takers. Results indicate that the proposed scorer shows strong positive correlations with expert human ratings and outperforms other scorers. However, the scorer shows some bias related to audio quality and language family groups. We conclude with future directions for mitigating bias and argue that this scorer holds potential for use in operational settings.
Zitieren
APA
Cai, D., Naismith, B., Kostromitina, M., Teng, Z., Yancey, K. P., & LaFlair, G. T. (2025). Developing an Automatic Pronunciation Scorer: Aligning Speech Evaluation Models and Applied Linguistics Constructs. Language Learning, 75(S1), 170-203. https://doi.org/10.1111/lang.70000
Vancouver
Cai D, Naismith B, Kostromitina M, Teng Z, Yancey KP, LaFlair GT. Developing an Automatic Pronunciation Scorer: Aligning Speech Evaluation Models and Applied Linguistics Constructs. Language Learning. 2025;75(S1):170-203. doi:10.1111/lang.70000
BibTeX
@article{Cai2025,
author = {Cai, Danwei and Naismith, Ben and Kostromitina, Maria and Teng, Zhongwei and Yancey, Kevin P. and LaFlair, Geoffrey T.},
title = {Developing an Automatic Pronunciation Scorer: Aligning Speech Evaluation Models and Applied Linguistics Constructs},
journal = {Language Learning},
year = {2025},
volume = {75},
number = {S1},
pages = {170--203},
doi = {10.1111/lang.70000}
}
EUVIMED