EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Developing an Automatic Pronunciation Scorer: Aligning Speech Evaluation Models and Applied Linguistics Constructs

Danwei Cai, Ben Naismith, Maria Kostromitina, Zhongwei Teng, Kevin P. Yancey, Geoffrey T. LaFlair

Language Learning · 2025-09 · 75 (S1) · 170-203

DOI: 10.1111/lang.70000 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Language Learning, online erschienen am 14.07.2025. Verfasst von Danwei Cai und 5 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Globalization and increases in the numbers of English language learners have led to a growing demand for English proficiency assessments of spoken language. In this paper, we describe the development of an automatic pronunciation scorer built on state‐of‐the‐art deep neural network models. The model is trained on a bespoke human‐rated dataset that reflects current perspectives on pronunciation and intelligibility. The new scorer is evaluated along three criteria: How well it explains expert human ratings, how it compares to other state‐of‐the‐art automatic pronunciation scorers in explaining expert human ratings, and the extent to which it exhibits bias toward different groups of test takers. Results indicate that the proposed scorer shows strong positive correlations with expert human ratings and outperforms other scorers. However, the scorer shows some bias related to audio quality and language family groups. We conclude with future directions for mitigating bias and argue that this scorer holds potential for use in operational settings.

Zitieren

APA

Cai, D., Naismith, B., Kostromitina, M., Teng, Z., Yancey, K. P., & LaFlair, G. T. (2025). Developing an Automatic Pronunciation Scorer: Aligning Speech Evaluation Models and Applied Linguistics Constructs. Language Learning, 75(S1), 170-203. https://doi.org/10.1111/lang.70000

Vancouver

Cai D, Naismith B, Kostromitina M, Teng Z, Yancey KP, LaFlair GT. Developing an Automatic Pronunciation Scorer: Aligning Speech Evaluation Models and Applied Linguistics Constructs. Language Learning. 2025;75(S1):170-203. doi:10.1111/lang.70000

BibTeX
@article{Cai2025,
  author = {Cai, Danwei and Naismith, Ben and Kostromitina, Maria and Teng, Zhongwei and Yancey, Kevin P. and LaFlair, Geoffrey T.},
  title = {Developing an Automatic Pronunciation Scorer: Aligning Speech Evaluation Models and Applied Linguistics Constructs},
  journal = {Language Learning},
  year = {2025},
  volume = {75},
  number = {S1},
  pages = {170--203},
  doi = {10.1111/lang.70000}
}
Kostenlos starten →