Automated Alignment of Math Items to Content Standards in Large‐Scale Assessments Using Language Models
Educational Measurement: Issues and Practice · 2026-09 · 45 (3)
DOI: 10.1111/emip.70038 ↗Kurz gefasst
Fachartikel in der Zeitschrift Educational Measurement: Issues and Practice, online erschienen am 06.07.2026. Verfasst von Qingshu Xu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Accurate alignment of items to content standards is critical for valid score interpretation in large‐scale assessments. This study evaluates three automated paradigms for aligning Math items with four domain labels and nineteen skill labels. First, we extracted instruction‐tuned embeddings, trained a suite of classical supervised machine‐learning models, and examined whether principal component analysis (PCA) improved performance. Second, we fine‐tuned a set of encoder‐only language models (11 BERT‐family models) for domain and skill alignment. Third, we explored ensemble learning via majority voting and stacking with multiple meta‐models. Results show that DeBERTa‐v3‐base achieved the best weighted‐average F 1 score for domain alignment (0.950), whereas RoBERTa‐large achieved the best weighted‐average F 1 score for skill alignment (0.869). PCA substantially improved linear classifiers based on embeddings but did not outperform fine‐tuned encoder‐only language models. Ensemble methods did not surpass the best single encoder‐only language model. Overall, the study provides a systematic comparison of embedding‐based classification, fine‐tuned encoder‐only language models, and ensemble strategies for automated item‐to‐standards alignment.
Zitieren
APA
Xu, Q., Jiao, H., Zhou, T., Li, M., Zhang, N., Peters, S., & Fu, Y. (2026). Automated Alignment of Math Items to Content Standards in Large‐Scale Assessments Using Language Models. Educational Measurement: Issues and Practice, 45(3). https://doi.org/10.1111/emip.70038
Vancouver
Xu Q, Jiao H, Zhou T, Li M, Zhang N, Peters S, et al. Automated Alignment of Math Items to Content Standards in Large‐Scale Assessments Using Language Models. Educational Measurement: Issues and Practice. 2026;45(3). doi:10.1111/emip.70038
BibTeX
@article{Xu2026,
author = {Xu, Qingshu and Jiao, Hong and Zhou, Tianyi and Li, Ming and Zhang, Nan and Peters, Sydney and Fu, Yanbin},
title = {Automated Alignment of Math Items to Content Standards in Large‐Scale Assessments Using Language Models},
journal = {Educational Measurement: Issues and Practice},
year = {2026},
volume = {45},
number = {3},
doi = {10.1111/emip.70038}
}
EUVIMED