EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing second language speaking assessment: Integrating large language models for Finnish and Finland Swedish proficiency scoring

Ekaterina Voskoboinik, Anna von Zansen, Nhan Chi Phan, Yaroslav Getman, Tamás Grósz, Mikko Kurimo

Language Testing · 2025-10 · 42 (4) · 508-538

DOI: 10.1177/02655322251351648 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Language Testing, online erschienen am 03.09.2025. Verfasst von Ekaterina Voskoboinik und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NordForsk, Research Council of Finland.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated speaking assessment (ASA) of second language proficiency benefits both learners and educators. However, developing these systems for less commonly taught languages like Finnish and Finland Swedish is hindered by the need for large datasets with equal representation of all proficiency levels. Traditional machine learning algorithms used in ASA are data-driven and consequently struggle to generalize to underrepresented proficiency levels. This study leverages large language models (LLMs) to enhance scoring performance in underrepresented proficiency levels through two approaches: augmenting the learner’s corpus with LLM-generated transcripts (simulating data) and applying LLMs to score the transcripts of learners’ responses directly. Our findings show that both solutions are comparable to or better than a traditional machine learning model trained on the original data for proficiency levels with fewer examples. Additionally, we found that providing LLMs with examples of human grading at various proficiency levels significantly enhances their performance as graders, especially when compared to using a single demonstration or none at all. Finally, our study confirms that using automatic speech recognition transcripts instead of human transcripts does not compromise assessment quality, enabling the development of LLM-based systems that can generate proficiency ratings directly from audio input.

Förderung

  • NordForsk
  • Research Council of Finland

Zitieren

APA

Voskoboinik, E., Zansen, A. V., Phan, N. C., Getman, Y., Grósz, T., & Kurimo, M. (2025). Enhancing second language speaking assessment: Integrating large language models for Finnish and Finland Swedish proficiency scoring. Language Testing, 42(4), 508-538. https://doi.org/10.1177/02655322251351648

Vancouver

Voskoboinik E, Zansen AV, Phan NC, Getman Y, Grósz T, Kurimo M. Enhancing second language speaking assessment: Integrating large language models for Finnish and Finland Swedish proficiency scoring. Language Testing. 2025;42(4):508-538. doi:10.1177/02655322251351648

BibTeX
@article{Voskoboinik2025,
  author = {Voskoboinik, Ekaterina and Zansen, Anna von and Phan, Nhan Chi and Getman, Yaroslav and Grósz, Tamás and Kurimo, Mikko},
  title = {Enhancing second language speaking assessment: Integrating large language models for Finnish and Finland Swedish proficiency scoring},
  journal = {Language Testing},
  year = {2025},
  volume = {42},
  number = {4},
  pages = {508--538},
  doi = {10.1177/02655322251351648}
}
Kostenlos starten →