Generalizability Theory for Randomly Parallel Testing
Journal of Educational Measurement · 2026-03 · 63 (1)
DOI: 10.1111/jedm.70029 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Educational Measurement, online erschienen am 21.01.2026. Verfasst von Won‐Chan Lee und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Advancements in artificial intelligence (AI) have brought significant changes to testing practices, including the emergence of randomly parallel testing (RPT), in which examinees receive different but psychometrically similar sets of items generated from templates or AI‐based systems. This paper presents a generalizability theory (GT) framework for estimating conditional standard errors of measurement (CSEMs) and related reliability indices, with a particular focus on design structures commonly encountered in RPT within domain‐referenced testing contexts. The proposed framework supports the evaluation of score precision across a variety of operational designs, including crossed, nested, and multivariate configurations. Several illustrative examples are provided to demonstrate the methodology in practical settings. The paper also addresses key psychometric and interpretive challenges associated with RPT and outlines promising directions for future research.
Zitieren
APA
Lee, W., Kim, S. Y., & Shin, S. (2026). Generalizability Theory for Randomly Parallel Testing. Journal of Educational Measurement, 63(1). https://doi.org/10.1111/jedm.70029
Vancouver
Lee W, Kim SY, Shin S. Generalizability Theory for Randomly Parallel Testing. Journal of Educational Measurement. 2026;63(1). doi:10.1111/jedm.70029
BibTeX
@article{Lee2026,
author = {Lee, Won‐Chan and Kim, Stella Y. and Shin, Seungwon},
title = {Generalizability Theory for Randomly Parallel Testing},
journal = {Journal of Educational Measurement},
year = {2026},
volume = {63},
number = {1},
doi = {10.1111/jedm.70029}
}
EUVIMED