EUVIMEDEUVIMED entdecken
Open Access

Beyond One-Size-Fits-All: A Differential Sensitivity Framework for Machine Learning–Based Detection of Anomalous Survey Responses

Cody Ding iD

Educational and Psychological Measurement · 01.06.2026

DOI: 10.1177/00131644261448404 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Educational and Psychological Measurement, online erschienen am 01.06.2026. Verfasst von Cody Ding. Beteiligte Einrichtung: University of Missouri-St. Louis, MO, USA. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Anomalous survey responses, including random, careless, extreme, acquiescent, straightline, and alternating responding, threaten the validity of survey-based research. Machine learning (ML) algorithms offer flexible, model-agnostic alternatives to traditional detection methods, yet their relative effectiveness across anomaly types remains poorly understood. This study evaluated 11 unsupervised anomaly detection algorithms spanning four paradigms (distance-based, density-based, reconstruction-based, and tree/boundary-based) against six simulated anomaly types embedded in a realistic survey dataset ( N = 3,000). Results revealed pronounced differential sensitivity: globally deviant patterns (random, extreme, alternating) were universally detectable, whereas careless and acquiescent responding required reconstruction- or boundary-based methods, and straightline responding resisted detection by all algorithms (maximum area under the receiver operating characteristic curve [AUC-ROC] < .70). No single algorithm dominated across all types. These findings argue for multimethod approaches combining ML algorithms with traditional response quality indicators, and provide a framework for selecting detection methods based on anticipated anomaly types.

Schlagwörter

Stichwörter der Autor:innen

anomaly detectionbenchmarkingmachine learningsurvey data qualityunsupervised learning

Autor:innen und Institutionen

  • University of Missouri-St. Louis, MO, USA.

ORCID-Profile: Cody Ding

Zitieren

APA

Ding, C. (2026). Beyond One-Size-Fits-All: A Differential Sensitivity Framework for Machine Learning–Based Detection of Anomalous Survey Responses. Educational and Psychological Measurement. https://doi.org/10.1177/00131644261448404

Vancouver

Ding C. Beyond One-Size-Fits-All: A Differential Sensitivity Framework for Machine Learning–Based Detection of Anomalous Survey Responses. Educational and Psychological Measurement. 2026. doi:10.1177/00131644261448404

BibTeX
@article{Ding2026,
  author = {Ding, Cody},
  title = {Beyond One-Size-Fits-All: A Differential Sensitivity Framework for Machine Learning–Based Detection of Anomalous Survey Responses},
  journal = {Educational and Psychological Measurement},
  year = {2026},
  doi = {10.1177/00131644261448404}
}
Kostenlos starten →