The use of item scores and response times to detect examinees who may have benefited from item preknowledge
British Journal of Mathematical and Statistical Psychology · 2020-11 · 73 (3) · 397-419
DOI: 10.1111/bmsp.12187 ↗Kurz gefasst
Fachartikel in der Zeitschrift British Journal of Mathematical and Statistical Psychology, online erschienen am 16.08.2019. Verfasst von Sandip Sinharay und 1 weiteren Autor:innen. Beteiligte Einrichtung: Educational Testing Service, Princeton, New Jersey, USA. Hauptthemen laut MEDLINE: Models, Statistical. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: Institute of Education Sciences, US Department of Education.
Abstract (Originalsprache)
According to Wollack and Schoenig (2018, The Sage encyclopedia of educational research, measurement, and evaluation . Thousand Oaks, CA: Sage, 260), benefiting from item preknowledge is one of the three broad types of test fraud that occur in educational assessments. We use tools from constrained statistical inference to suggest a new statistic that is based on item scores and response times and can be used to detect examinees who may have benefited from item preknowledge for the case when the set of compromised items is known. The asymptotic distribution of the new statistic under no preknowledge is proved to be a simple mixture of two χ 2 distributions. We perform a detailed simulation study to show that the Type I error rate of the new statistic is very close to the nominal level and that the power of the new statistic is satisfactory in comparison to that of the existing statistics for detecting item preknowledge based on both item scores and response times. We also include a real data example to demonstrate the usefulness of the suggested statistic.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Educational Testing Service, Princeton, New Jersey, USA.
ORCID-Profile: Sandip Sinharay, Matthew S Johnson
Förderung
- Institute of Education Sciences
- US Department of Education
Zitieren
APA
Sinharay, S., & Johnson, M. S. (2020). The use of item scores and response times to detect examinees who may have benefited from item preknowledge. British Journal of Mathematical and Statistical Psychology, 73(3), 397-419. https://doi.org/10.1111/bmsp.12187
Vancouver
Sinharay S, Johnson MS. The use of item scores and response times to detect examinees who may have benefited from item preknowledge. British Journal of Mathematical and Statistical Psychology. 2020;73(3):397-419. doi:10.1111/bmsp.12187
BibTeX
@article{Sinharay2020,
author = {Sinharay, Sandip and Johnson, Matthew S},
title = {The use of item scores and response times to detect examinees who may have benefited from item preknowledge},
journal = {British Journal of Mathematical and Statistical Psychology},
year = {2020},
volume = {73},
number = {3},
pages = {397--419},
doi = {10.1111/bmsp.12187}
}
EUVIMED