Prompt Engineering to CEFR Alignment: Investigating Generative AI for the Creation of English Listening Assessments
Eduvelop: Journal of English Education and Development · 31.03.2026 · 9 (1) · 329-339
DOI: 10.31605/eduvelop.v9i1.6207 ↗Kurz gefasst
Fachartikel in der Zeitschrift Eduvelop: Journal of English Education and Development, online erschienen am 31.03.2026. Verfasst von Fikri Asih Wigati und 3 weiteren Autor:innen.
Abstract (Originalsprache)
Meeting the increasing demand for internationally benchmarked English listening exams is difficult, especially in educational settings with limited resources. In a human–AI collaboration framework, this study investigates the feasibility of using generative artificial intelligence, specifically ChatGPT-4, to support the early development of English listening scripts and test items aligned with the CEFR. Using an exploratory research design, the study generated 20 listening scripts and matching multiple-choice questions across CEFR reference levels A2, B1, B2, and C1 using an iterative prompt engineering technique called Progressive-Hint Prompting (PHP). The produced materials were examined using Text Inspector's descriptive linguistic metrics, which included qualitative assessments of spoken discourse characteristics, topical coverage, and distractor plausibility, as well as lexical profile, readability, and script length. The results show that when guided by structured prompts and ongoing human evaluation, ChatGPT-4 can perform well as a drafting aid. The created scripts demonstrated systematic linguistic variance across CEFR reference levels, particularly in lexical range and text complexity. Nevertheless, several drawbacks were noted, including unequal topical distribution, decreased pragmatic naturalness at higher competence levels, and inconsistent calibration of spoken discourse features. To ensure that distractors were text-based and aligned with assessment criteria, item quality needed to be refined iteratively. These results imply that iterative human-AI interaction, rather than automated generation alone, determines the quality of AI-generated listening materials. The study emphasizes the ongoing importance of professional human oversight while highlighting the potential of generative AI as a resource-efficient support tool for the development of listening assessments. To investigate the efficacy of AI-assisted materials in operational assessment contexts, future research should focus on empirical validation with test takers.
Zitieren
APA
Wigati, F. A., Hakim, P. K., Pujiawati, N., & Rahmawati, M. (2026). Prompt Engineering to CEFR Alignment: Investigating Generative AI for the Creation of English Listening Assessments. Eduvelop: Journal of English Education and Development, 9(1), 329-339. https://doi.org/10.31605/eduvelop.v9i1.6207
Vancouver
Wigati FA, Hakim PK, Pujiawati N, Rahmawati M. Prompt Engineering to CEFR Alignment: Investigating Generative AI for the Creation of English Listening Assessments. Eduvelop: Journal of English Education and Development. 2026;9(1):329-339. doi:10.31605/eduvelop.v9i1.6207
BibTeX
@article{Wigati2026,
author = {Wigati, Fikri Asih and Hakim, Putri Kamalia and Pujiawati, Nia and Rahmawati, Maya},
title = {Prompt Engineering to CEFR Alignment: Investigating Generative AI for the Creation of English Listening Assessments},
journal = {Eduvelop: Journal of English Education and Development},
year = {2026},
volume = {9},
number = {1},
pages = {329--339},
doi = {10.31605/eduvelop.v9i1.6207}
}
EUVIMED