Detection and Treatment of Careless Responses to Improve Item Parameter Estimation
Journal of Educational and Behavioral Statistics · 2019-06 · 44 (3) · 309-341
DOI: 10.3102/1076998618825116 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Educational and Behavioral Statistics, online erschienen am 03.02.2019. Verfasst von Jeffrey M. Patton und 3 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: CTB McGraw-Hill.
Abstract (Originalsprache)
In psychological and survey research, the prevalence and serious consequences of careless responses from unmotivated participants are well known. In this study, we propose to iteratively detect careless responders and cleanse the data by removing their responses. The careless responders are detected using person-fit statistics. In two simulation studies, the iterative procedure leads to nearly perfect power in detecting extremely careless responders and much higher power than the noniterative procedure in detecting moderately careless responders. Meanwhile, the false-positive error rate is close to the nominal level. In addition, item parameter estimation is much improved by iteratively cleansing the calibration sample. The bias in item discrimination and location parameter estimates is substantially reduced. The standard error estimates, which are spuriously small in the presence of careless responses, are corrected by the iterative cleansing procedure. An empirical example is also presented to illustrate the proposed procedure. These results suggest that the proposed procedure is a promising way to improve item parameter estimation for tests of 20 items or longer when data are contaminated by careless responses.
Förderung
- CTB McGraw-Hill
Zitieren
APA
Patton, J. M., Cheng, Y., Hong, M., & Diao, Q. (2019). Detection and Treatment of Careless Responses to Improve Item Parameter Estimation. Journal of Educational and Behavioral Statistics, 44(3), 309-341. https://doi.org/10.3102/1076998618825116
Vancouver
Patton JM, Cheng Y, Hong M, Diao Q. Detection and Treatment of Careless Responses to Improve Item Parameter Estimation. Journal of Educational and Behavioral Statistics. 2019;44(3):309-341. doi:10.3102/1076998618825116
BibTeX
@article{Patton2019,
author = {Patton, Jeffrey M. and Cheng, Ying and Hong, Maxwell and Diao, Qi},
title = {Detection and Treatment of Careless Responses to Improve Item Parameter Estimation},
journal = {Journal of Educational and Behavioral Statistics},
year = {2019},
volume = {44},
number = {3},
pages = {309--341},
doi = {10.3102/1076998618825116}
}
EUVIMED