Detecting Preknowledge Cheating via Innovative Measures: A Mixture Hierarchical Model for Jointly Modeling Item Responses, Response Times, and Visual Fixation Counts
Educational and Psychological Measurement · 2023-10 · 83 (5) · 1059-1080
DOI: 10.1177/00131644221136142 ↗Kurz gefasst
Fachartikel in der Zeitschrift Educational and Psychological Measurement, online erschienen am 16.11.2022. Verfasst von Kaiwen Man und 1 weiteren Autor:innen. Beteiligte Einrichtung: University of Alabama, Tuscaloosa, USA. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Preknowledge cheating jeopardizes the validity of inferences based on test results. Many methods have been developed to detect preknowledge cheating by jointly analyzing item responses and response times. Gaze fixations, an essential eye-tracker measure, can be utilized to help detect aberrant testing behavior with improved accuracy beyond using product and process data types in isolation. As such, this study proposes a mixture hierarchical model that integrates item responses, response times, and visual fixation counts collected from an eye-tracker (a) to detect aberrant test takers who have different levels of preknowledge and (b) to account for nuances in behavioral patterns between normally-behaved and aberrant examinees. A Bayesian approach to estimating model parameters is carried out via an MCMC algorithm. Finally, the proposed model is applied to experimental data to illustrate how the model can be used to identify test takers having preknowledge on the test items.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- University of Alabama, Tuscaloosa, USA.
- University of Maryland, College Park, USA.
ORCID-Profile: Kaiwen Man, Jeffrey R Harring
Zitieren
APA
Man, K., & Harring, J. R. (2023). Detecting Preknowledge Cheating via Innovative Measures: A Mixture Hierarchical Model for Jointly Modeling Item Responses, Response Times, and Visual Fixation Counts. Educational and Psychological Measurement, 83(5), 1059-1080. https://doi.org/10.1177/00131644221136142
Vancouver
Man K, Harring JR. Detecting Preknowledge Cheating via Innovative Measures: A Mixture Hierarchical Model for Jointly Modeling Item Responses, Response Times, and Visual Fixation Counts. Educational and Psychological Measurement. 2023;83(5):1059-1080. doi:10.1177/00131644221136142
BibTeX
@article{Man2023,
author = {Man, Kaiwen and Harring, Jeffrey R},
title = {Detecting Preknowledge Cheating via Innovative Measures: A Mixture Hierarchical Model for Jointly Modeling Item Responses, Response Times, and Visual Fixation Counts},
journal = {Educational and Psychological Measurement},
year = {2023},
volume = {83},
number = {5},
pages = {1059--1080},
doi = {10.1177/00131644221136142}
}
EUVIMED