Enhancing second language speaking assessment: Integrating large language models for Finnish and Finland Swedish proficiency scoring
Language Testing · 2025-10 · 42 (4) · 508-538
DOI: 10.1177/02655322251351648 ↗Kurz gefasst
Fachartikel in der Zeitschrift Language Testing, online erschienen am 03.09.2025. Verfasst von Ekaterina Voskoboinik und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NordForsk, Research Council of Finland.
Abstract (Originalsprache)
Automated speaking assessment (ASA) of second language proficiency benefits both learners and educators. However, developing these systems for less commonly taught languages like Finnish and Finland Swedish is hindered by the need for large datasets with equal representation of all proficiency levels. Traditional machine learning algorithms used in ASA are data-driven and consequently struggle to generalize to underrepresented proficiency levels. This study leverages large language models (LLMs) to enhance scoring performance in underrepresented proficiency levels through two approaches: augmenting the learner’s corpus with LLM-generated transcripts (simulating data) and applying LLMs to score the transcripts of learners’ responses directly. Our findings show that both solutions are comparable to or better than a traditional machine learning model trained on the original data for proficiency levels with fewer examples. Additionally, we found that providing LLMs with examples of human grading at various proficiency levels significantly enhances their performance as graders, especially when compared to using a single demonstration or none at all. Finally, our study confirms that using automatic speech recognition transcripts instead of human transcripts does not compromise assessment quality, enabling the development of LLM-based systems that can generate proficiency ratings directly from audio input.
Förderung
- NordForsk
- Research Council of Finland
Zitieren
APA
Voskoboinik, E., Zansen, A. V., Phan, N. C., Getman, Y., Grósz, T., & Kurimo, M. (2025). Enhancing second language speaking assessment: Integrating large language models for Finnish and Finland Swedish proficiency scoring. Language Testing, 42(4), 508-538. https://doi.org/10.1177/02655322251351648
Vancouver
Voskoboinik E, Zansen AV, Phan NC, Getman Y, Grósz T, Kurimo M. Enhancing second language speaking assessment: Integrating large language models for Finnish and Finland Swedish proficiency scoring. Language Testing. 2025;42(4):508-538. doi:10.1177/02655322251351648
BibTeX
@article{Voskoboinik2025,
author = {Voskoboinik, Ekaterina and Zansen, Anna von and Phan, Nhan Chi and Getman, Yaroslav and Grósz, Tamás and Kurimo, Mikko},
title = {Enhancing second language speaking assessment: Integrating large language models for Finnish and Finland Swedish proficiency scoring},
journal = {Language Testing},
year = {2025},
volume = {42},
number = {4},
pages = {508--538},
doi = {10.1177/02655322251351648}
}
EUVIMED