Flagging insufficient effort responses in surveys: Stopping rule to prevent insufficient or excessive removal of doubtful data
Acta Psychologica · 2024-03 · 243 · 104135
DOI: 10.1016/j.actpsy.2024.104135 ↗Kurz gefasst
Fachartikel in der Zeitschrift Acta Psychologica, 2024-03. Verfasst von Melissa Dan Wang und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Educational Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong, China. Electronic address: MelissaDanWang@link.cuhk.edu…. Hauptthemen laut MEDLINE: Surveys and Questionnaires. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Detecting participants not exerting sufficient effort (e.g., answering randomly; termed 'insufficient effort responding' or IER) in self-report surveys is crucial but intricate. Challenges of appropriately removing IER resemble a surgeon excising necrotic tissue without being inadequate, excessive, or incorrect. Current cutoff criteria for stopping the elimination of suspected IER responses are often arbitrary. This study proposes an external criterion strategy to identify the optimal cutoff values for various IER detection methods. We investigated the change in correlations between the IER-containing scale (e.g., motivation) and the external criterion (e.g., academic performance, socioeconomic status index, or another questionnaire scale) utilizing simulated and authentic international survey data. The findings revealed that the stopping rule and consequently, the optimal cutoff values for IER detection methods, can be accurately identified by locating the inflection point in the correlation plot with the external criterion. Practical strategies are recommended for applied researchers.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Educational Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong, China. Electronic address: MelissaDanWang@link.cuhk.edu.hk.
- Department of Educational Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong, China. Electronic address: kthau@cuhk.edu.hk.
Zitieren
APA
Wang, M. D., & Hau, K. T. (2024). Flagging insufficient effort responses in surveys: Stopping rule to prevent insufficient or excessive removal of doubtful data. Acta Psychologica, 243, 104135. https://doi.org/10.1016/j.actpsy.2024.104135
Vancouver
Wang MD, Hau KT. Flagging insufficient effort responses in surveys: Stopping rule to prevent insufficient or excessive removal of doubtful data. Acta Psychologica. 2024;243:104135. doi:10.1016/j.actpsy.2024.104135
BibTeX
@article{Wang2024,
author = {Wang, Melissa Dan and Hau, Kit-Tai},
title = {Flagging insufficient effort responses in surveys: Stopping rule to prevent insufficient or excessive removal of doubtful data},
journal = {Acta Psychologica},
year = {2024},
volume = {243},
pages = {104135},
doi = {10.1016/j.actpsy.2024.104135}
}
EUVIMED