EUVIMEDEUVIMED entdecken
Crossref

Enhancing Preknowledge Detection in CAT: A Weighted Residual Statistic Via Posterior Predictive Model Checking

Zhicheng Liu, Chunying Qin, Zhaosheng Luo, Xiaofeng Yu

Journal of Educational and Behavioral Statistics · 09.11.2026

DOI: 10.3102/10769986261472058 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Educational and Behavioral Statistics, online erschienen am 09.11.2026. Verfasst von Zhicheng Liu und 3 weiteren Autor:innen. Die Arbeit nennt 42 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the continuous administration framework of computerized adaptive testing (CAT), item preknowledge poses a significant threat to test fairness and security of the item bank. Traditional person-fit statistics (e.g., l z ) often fail in CAT due to their reliance on asymptotic normality assumptions that are easily violated in short tests. While cumulative sum (CUSUM) methods are better suited for dynamic testing environments, they still face limitations, including insufficient detection power in short tests, the lack of optimization for preknowledge-specific patterns in standardized residual statistics, and an inherent mismatch with the non-continuous nature of preknowledge behaviors. This study proposes a new weighted residual statistic that amplifies abnormal signals by weighting positive residuals and introduces the posterior predictive model checking (PPMC) framework. By simulating examinees’ personalized testing processes to generate posterior distributions, PPMC establishes individualized critical values, providing a precise and adaptive diagnostic standard for CAT environments. Both simulation and empirical studies demonstrate that the weighted residual statistic, integrated with PPMC, effectively optimizes Type I error rates and exhibits higher detection power across various testing conditions compared to traditional statistics. This study provides a sensitive, robust, and practical solution for operational security monitoring in CAT.

Zitieren

APA

Liu, Z., Qin, C., Luo, Z., & Yu, X. (2026). Enhancing Preknowledge Detection in CAT: A Weighted Residual Statistic Via Posterior Predictive Model Checking. Journal of Educational and Behavioral Statistics. https://doi.org/10.3102/10769986261472058

Vancouver

Liu Z, Qin C, Luo Z, Yu X. Enhancing Preknowledge Detection in CAT: A Weighted Residual Statistic Via Posterior Predictive Model Checking. Journal of Educational and Behavioral Statistics. 2026. doi:10.3102/10769986261472058

BibTeX
@article{Liu2026,
  author = {Liu, Zhicheng and Qin, Chunying and Luo, Zhaosheng and Yu, Xiaofeng},
  title = {Enhancing Preknowledge Detection in CAT: A Weighted Residual Statistic Via Posterior Predictive Model Checking},
  journal = {Journal of Educational and Behavioral Statistics},
  year = {2026},
  doi = {10.3102/10769986261472058}
}
Kostenlos starten →