Testing Differential Item Functioning Without Predefined Anchor Items Using Robust Regression
Journal of Educational and Behavioral Statistics · 2022-12 · 47 (6) · 666-692
DOI: 10.3102/10769986221109208 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Educational and Behavioral Statistics, online erschienen am 18.07.2022. Verfasst von Weimeng Wang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 40 Literaturangaben.
Abstract (Originalsprache)
Differential item functioning (DIF) occurs when the probability of endorsing an item differs across groups for individuals with the same latent trait level. The presence of DIF items may jeopardize the validity of an instrument; therefore, it is crucial to identify DIF items in routine operations of educational assessment. While DIF detection procedures based on item response theory (IRT) have been widely used, a majority of IRT-based DIF tests assume predefined anchor (i.e., DIF-free) items. Not only is this assumption strong, but violations to it may also lead to erroneous inferences, for example, an inflated Type I error rate. We propose a general framework to define the effect sizes of DIF without a priori knowledge of anchor items. In particular, we quantify DIF by item-specific residuals from a regression model fitted to the true item parameters in respective groups. Moreover, the null distribution of the proposed test statistic using robust estimator can be derived analytically or approximated numerically even when there is a mix of DIF and non-DIF items, which yields asymptotically justified statistical inference. The Type I error rate and the power performance of the proposed procedure are evaluated and compared with the conventional likelihood-ratio DIF tests in a Monte Carlo experiment. Our simulation study has shown promising results in controlling Type I error rate and power of detecting DIF items. Even when there is a mix of DIF and non-DIF items, the true and false alarm rate can be well controlled when a robust regression estimator is used.
Zitieren
APA
Wang, W., Liu, Y., & Liu, H. (2022). Testing Differential Item Functioning Without Predefined Anchor Items Using Robust Regression. Journal of Educational and Behavioral Statistics, 47(6), 666-692. https://doi.org/10.3102/10769986221109208
Vancouver
Wang W, Liu Y, Liu H. Testing Differential Item Functioning Without Predefined Anchor Items Using Robust Regression. Journal of Educational and Behavioral Statistics. 2022;47(6):666-692. doi:10.3102/10769986221109208
BibTeX
@article{Wang2022,
author = {Wang, Weimeng and Liu, Yang and Liu, Hongyun},
title = {Testing Differential Item Functioning Without Predefined Anchor Items Using Robust Regression},
journal = {Journal of Educational and Behavioral Statistics},
year = {2022},
volume = {47},
number = {6},
pages = {666--692},
doi = {10.3102/10769986221109208}
}
EUVIMED