EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Word Predictability as a Measure of Second Language Proficiency

Langdon Holmes, Scott Crossley, Wesley Morris, Joon Suh Choi

Language Learning · 09.07.2026

DOI: 10.1111/lang.70037 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Language Learning, online erschienen am 09.07.2026. Verfasst von Langdon Holmes und 3 weiteren Autor:innen. Die Arbeit nennt 99 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study introduces predictability BERT , a novel metric for assessing second language (L2) proficiency based on the predictability of word choices in learner language production. Using BERT (Devlin et al., 2019), we calculated the conditional probability of each word in a text given its surrounding context. We evaluated predictability BERT on two datasets: the Lexical Proficiency Corpus ( N = 480), containing analytic ratings of lexical proficiency, and TOEFL 11 ( N = 11,000; Blanchard et al., 2013), containing standardized language proficiency scores. Results show that predictability BERT correlated with ratings of collocation accuracy ( r = .80) and lexical proficiency ( r = .73). In a multilevel model, predictability BERT was the strongest predictor of language proficiency compared to conventional measures of lexical and phraseological sophistication, explaining 59% of variance in TOEFL scores. These findings suggest high‐proficiency L2 learners make more predictable word choices, supporting usage‐based theories emphasizing the role of statistical learning in L2 development.

Zitieren

APA

Holmes, L., Crossley, S., Morris, W., & Choi, J. S. (2026). Word Predictability as a Measure of Second Language Proficiency. Language Learning. https://doi.org/10.1111/lang.70037

Vancouver

Holmes L, Crossley S, Morris W, Choi JS. Word Predictability as a Measure of Second Language Proficiency. Language Learning. 2026. doi:10.1111/lang.70037

BibTeX
@article{Holmes2026,
  author = {Holmes, Langdon and Crossley, Scott and Morris, Wesley and Choi, Joon Suh},
  title = {Word Predictability as a Measure of Second Language Proficiency},
  journal = {Language Learning},
  year = {2026},
  doi = {10.1111/lang.70037}
}
Kostenlos starten →