Careless responding detection revisited: Accuracy of direct and indirect measures
Behavior Research Methods · 15.08.2024 · 56 (8) · 8422-8449
DOI: 10.3758/s13428-024-02484-3 ↗Kurz gefasst
Fachartikel in der Zeitschrift Behavior Research Methods, online erschienen am 15.08.2024. Verfasst von Philippe Goldammer und 5 weiteren Autor:innen. Beteiligte Einrichtung: Military Academy at ETH Zurich, Birmensdorf, Switzerland. philippe.goldammer@milak.ethz.ch. Hauptthemen laut MEDLINE: Personality. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
To screen for careless responding, researchers have a choice between several direct measures (i.e., bogus items, requiring the respondent to choose a specific answer) and indirect measures (i.e., unobtrusive post hoc indices). Given the dearth of research in the area, we examined how well direct and indirect indices perform relative to each other. In five experimental studies, we investigated whether the detection rates of the measures are affected by contextual factors: severity of the careless response pattern, type of item keying, and type of item presentation. We fully controlled the information environment by experimentally inducing careless response sets under a variety of contextual conditions. In Studies 1 and 2, participants rated the personality of an actor that presented himself in a 5-min-long videotaped speech. In Studies 3, 4, and 5, participants had to rate their own personality across two measurements. With the exception of maximum longstring, intra-individual response variability, and individual contribution to model misfit, all examined indirect indices performed better than chance in most of the examined conditions. Moreover, indirect indices had detection rates as good as and, in many cases, better than the detection rates of direct measures. We therefore encourage researchers to use indirect indices, especially within-person consistency indices, instead of direct measures.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Military Academy at ETH Zurich, Birmensdorf, Switzerland. philippe.goldammer@milak.ethz.ch.
- Military Academy at ETH Zurich, Birmensdorf, Switzerland.
- Leuphana University Lüneburg, Lüneburg, Germany.
- University of Zurich, Zurich, Switzerland.
- University of Lausanne, Lausanne, Switzerland.
ORCID-Profile: Philippe Goldammer, Peter Lucas Stöckli, Yannik Andrea Escher, Hubert Annen, Klaus Jonas, John Antonakis
Zitieren
APA
Goldammer, P., Stöckli, P. L., Escher, Y. A., Annen, H., Jonas, K., & Antonakis, J. (2024). Careless responding detection revisited: Accuracy of direct and indirect measures. Behavior Research Methods, 56(8), 8422-8449. https://doi.org/10.3758/s13428-024-02484-3
Vancouver
Goldammer P, Stöckli PL, Escher YA, Annen H, Jonas K, Antonakis J. Careless responding detection revisited: Accuracy of direct and indirect measures. Behavior Research Methods. 2024;56(8):8422-8449. doi:10.3758/s13428-024-02484-3
BibTeX
@article{Goldammer2024,
author = {Goldammer, Philippe and Stöckli, Peter Lucas and Escher, Yannik Andrea and Annen, Hubert and Jonas, Klaus and Antonakis, John},
title = {Careless responding detection revisited: Accuracy of direct and indirect measures},
journal = {Behavior Research Methods},
year = {2024},
volume = {56},
number = {8},
pages = {8422--8449},
doi = {10.3758/s13428-024-02484-3}
}
EUVIMED