EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Flagging insufficient effort responses in surveys: Stopping rule to prevent insufficient or excessive removal of doubtful data

Melissa Dan Wang, Kit-Tai Hau

Acta Psychologica · 2024-03 · 243 · 104135

DOI: 10.1016/j.actpsy.2024.104135 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Acta Psychologica, 2024-03. Verfasst von Melissa Dan Wang und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Educational Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong, China. Electronic address: MelissaDanWang@link.cuhk.edu…. Hauptthemen laut MEDLINE: Surveys and Questionnaires. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Detecting participants not exerting sufficient effort (e.g., answering randomly; termed 'insufficient effort responding' or IER) in self-report surveys is crucial but intricate. Challenges of appropriately removing IER resemble a surgeon excising necrotic tissue without being inadequate, excessive, or incorrect. Current cutoff criteria for stopping the elimination of suspected IER responses are often arbitrary. This study proposes an external criterion strategy to identify the optimal cutoff values for various IER detection methods. We investigated the change in correlations between the IER-containing scale (e.g., motivation) and the external criterion (e.g., academic performance, socioeconomic status index, or another questionnaire scale) utilizing simulated and authentic international survey data. The findings revealed that the stopping rule and consequently, the optimal cutoff values for IER detection methods, can be accurately identified by locating the inflection point in the correlation plot with the external criterion. Practical strategies are recommended for applied researchers.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Surveys and QuestionnairesHumansSelf Report

Stichwörter der Autor:innen

Careless respondingData qualityInsufficient effort respondingSurvey methodology

Autor:innen und Institutionen

  • Department of Educational Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong, China. Electronic address: MelissaDanWang@link.cuhk.edu.hk.
  • Department of Educational Psychology, The Chinese University of Hong Kong, Shatin, Hong Kong, China. Electronic address: kthau@cuhk.edu.hk.

Zitieren

APA

Wang, M. D., & Hau, K. T. (2024). Flagging insufficient effort responses in surveys: Stopping rule to prevent insufficient or excessive removal of doubtful data. Acta Psychologica, 243, 104135. https://doi.org/10.1016/j.actpsy.2024.104135

Vancouver

Wang MD, Hau KT. Flagging insufficient effort responses in surveys: Stopping rule to prevent insufficient or excessive removal of doubtful data. Acta Psychologica. 2024;243:104135. doi:10.1016/j.actpsy.2024.104135

BibTeX
@article{Wang2024,
  author = {Wang, Melissa Dan and Hau, Kit-Tai},
  title = {Flagging insufficient effort responses in surveys: Stopping rule to prevent insufficient or excessive removal of doubtful data},
  journal = {Acta Psychologica},
  year = {2024},
  volume = {243},
  pages = {104135},
  doi = {10.1016/j.actpsy.2024.104135}
}
Kostenlos starten →