EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Automated Alignment of Math Items to Content Standards in Large‐Scale Assessments Using Language Models

Qingshu Xu, Hong Jiao, Tianyi Zhou, Ming Li, Nan Zhang, Sydney Peters, Yanbin Fu

Educational Measurement: Issues and Practice · 2026-09 · 45 (3)

DOI: 10.1111/emip.70038 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Educational Measurement: Issues and Practice, online erschienen am 06.07.2026. Verfasst von Qingshu Xu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurate alignment of items to content standards is critical for valid score interpretation in large‐scale assessments. This study evaluates three automated paradigms for aligning Math items with four domain labels and nineteen skill labels. First, we extracted instruction‐tuned embeddings, trained a suite of classical supervised machine‐learning models, and examined whether principal component analysis (PCA) improved performance. Second, we fine‐tuned a set of encoder‐only language models (11 BERT‐family models) for domain and skill alignment. Third, we explored ensemble learning via majority voting and stacking with multiple meta‐models. Results show that DeBERTa‐v3‐base achieved the best weighted‐average F 1 score for domain alignment (0.950), whereas RoBERTa‐large achieved the best weighted‐average F 1 score for skill alignment (0.869). PCA substantially improved linear classifiers based on embeddings but did not outperform fine‐tuned encoder‐only language models. Ensemble methods did not surpass the best single encoder‐only language model. Overall, the study provides a systematic comparison of embedding‐based classification, fine‐tuned encoder‐only language models, and ensemble strategies for automated item‐to‐standards alignment.

Zitieren

APA

Xu, Q., Jiao, H., Zhou, T., Li, M., Zhang, N., Peters, S., & Fu, Y. (2026). Automated Alignment of Math Items to Content Standards in Large‐Scale Assessments Using Language Models. Educational Measurement: Issues and Practice, 45(3). https://doi.org/10.1111/emip.70038

Vancouver

Xu Q, Jiao H, Zhou T, Li M, Zhang N, Peters S, et al. Automated Alignment of Math Items to Content Standards in Large‐Scale Assessments Using Language Models. Educational Measurement: Issues and Practice. 2026;45(3). doi:10.1111/emip.70038

BibTeX
@article{Xu2026,
  author = {Xu, Qingshu and Jiao, Hong and Zhou, Tianyi and Li, Ming and Zhang, Nan and Peters, Sydney and Fu, Yanbin},
  title = {Automated Alignment of Math Items to Content Standards in Large‐Scale Assessments Using Language Models},
  journal = {Educational Measurement: Issues and Practice},
  year = {2026},
  volume = {45},
  number = {3},
  doi = {10.1111/emip.70038}
}
Kostenlos starten →