Beyond One-Size-Fits-All: A Differential Sensitivity Framework for Machine Learning–Based Detection of Anomalous Survey Responses
Educational and Psychological Measurement · 01.06.2026
DOI: 10.1177/00131644261448404 ↗Kurz gefasst
Fachartikel in der Zeitschrift Educational and Psychological Measurement, online erschienen am 01.06.2026. Verfasst von Cody Ding. Beteiligte Einrichtung: University of Missouri-St. Louis, MO, USA. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Anomalous survey responses, including random, careless, extreme, acquiescent, straightline, and alternating responding, threaten the validity of survey-based research. Machine learning (ML) algorithms offer flexible, model-agnostic alternatives to traditional detection methods, yet their relative effectiveness across anomaly types remains poorly understood. This study evaluated 11 unsupervised anomaly detection algorithms spanning four paradigms (distance-based, density-based, reconstruction-based, and tree/boundary-based) against six simulated anomaly types embedded in a realistic survey dataset ( N = 3,000). Results revealed pronounced differential sensitivity: globally deviant patterns (random, extreme, alternating) were universally detectable, whereas careless and acquiescent responding required reconstruction- or boundary-based methods, and straightline responding resisted detection by all algorithms (maximum area under the receiver operating characteristic curve [AUC-ROC] < .70). No single algorithm dominated across all types. These findings argue for multimethod approaches combining ML algorithms with traditional response quality indicators, and provide a framework for selecting detection methods based on anticipated anomaly types.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- University of Missouri-St. Louis, MO, USA.
ORCID-Profile: Cody Ding
Zitieren
APA
Ding, C. (2026). Beyond One-Size-Fits-All: A Differential Sensitivity Framework for Machine Learning–Based Detection of Anomalous Survey Responses. Educational and Psychological Measurement. https://doi.org/10.1177/00131644261448404
Vancouver
Ding C. Beyond One-Size-Fits-All: A Differential Sensitivity Framework for Machine Learning–Based Detection of Anomalous Survey Responses. Educational and Psychological Measurement. 2026. doi:10.1177/00131644261448404
BibTeX
@article{Ding2026,
author = {Ding, Cody},
title = {Beyond One-Size-Fits-All: A Differential Sensitivity Framework for Machine Learning–Based Detection of Anomalous Survey Responses},
journal = {Educational and Psychological Measurement},
year = {2026},
doi = {10.1177/00131644261448404}
}
EUVIMED