EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Identifying careless responding in ecological momentary assessment: Inconsistent signals from different detection methods in the WARN-D Data.

Leonie V D E Vogelsmeier iD, Björn S Siepe iD, Esther Ulitzsch iD, Gudrun Eisele iD, Joran Geeraerts iD, Adam Klocek iD, Ricarda K K Proppert iD, Carlotta L Rieble iD, Rayyan Tutunji iD, Egon Dejonckheere iD, Peter Kuppens iD, Eiko I Fried iD

Psychological Methods · 13.07.2026

DOI: 10.1037/met0000845 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Psychological Methods, online erschienen am 13.07.2026. Verfasst von Leonie V D E Vogelsmeier und 11 weiteren Autor:innen. Beteiligte Einrichtung: Department of Methodology and Statistics, Tilburg University. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: European Research Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Collecting intensive longitudinal data via methods like ecological momentary assessment (EMA) is necessary to study dynamics in psychological constructs. However, detecting careless responding is more important than ever, as this methodology burdens participants more than traditional single-survey studies. If undetected, careless responding reduces data quality and can lead to invalid findings by distorting correlations between items and constructs and compromising the psychometric properties of scales. In turn, this hinders progress toward cumulative psychological science. In recent years, several data-driven approaches have been proposed that assess whether an individual was attentive or careless for each time point-specific measurement after data collection. However, the variety and complexity of available methods can be overwhelming for researchers. In this article, we summarized, applied, and compared 13 methods that flag careless responses in a rich EMA data set from the WARN-D study with 206,318 observations (from n = 1,194 participants). Together with our detailed online supplementary tutorials, the article serves as a guide for researchers to evaluate and report careless responding in their own data. At the same time, we show that the development of methods for careless responding detection is still in its early stages, as the studied approaches produced very different results. We provide recommendations for which methods are currently most promising based on our findings and discuss important next steps in validating them empirically. (PsycInfo Database Record (c) 2026 APA, all rights reserved).

Autor:innen und Institutionen

  • Department of Methodology and Statistics, Tilburg University.
  • Psychological Methods Lab, Department of Psychology, University of Marburg.
  • Centre for Educational Measurement, University of Oslo.
  • Center for Contextual Psychiatry, Department of Neuroscience, KU Leuven.
  • Faculty of Medicine and Pharmacy, Vrije Universiteit Brussel.
  • Psychology Research Institute, Faculty of Social Studies, Masaryk University.

ORCID-Profile: Leonie V D E Vogelsmeier, Björn S Siepe, Esther Ulitzsch, Gudrun Eisele, Joran Geeraerts, Adam Klocek, Ricarda K K Proppert, Carlotta L Rieble, Rayyan Tutunji, Egon Dejonckheere, Peter Kuppens, Eiko I Fried

Förderung

  • European Research Council

Zitieren

APA

Vogelsmeier, L. V. D. E., Siepe, B. S., Ulitzsch, E., Eisele, G., Geeraerts, J., Klocek, A., Proppert, R. K. K., Rieble, C. L., Tutunji, R., Dejonckheere, E., Kuppens, P., & Fried, E. I. (2026). Identifying careless responding in ecological momentary assessment: Inconsistent signals from different detection methods in the WARN-D Data. Psychological Methods. https://doi.org/10.1037/met0000845

Vancouver

Vogelsmeier LVDE, Siepe BS, Ulitzsch E, Eisele G, Geeraerts J, Klocek A, et al. Identifying careless responding in ecological momentary assessment: Inconsistent signals from different detection methods in the WARN-D Data. Psychological Methods. 2026. doi:10.1037/met0000845

BibTeX
@article{Vogelsmeier2026,
  author = {Vogelsmeier, Leonie V D E and Siepe, Björn S and Ulitzsch, Esther and Eisele, Gudrun and Geeraerts, Joran and Klocek, Adam and Proppert, Ricarda K K and Rieble, Carlotta L and Tutunji, Rayyan and Dejonckheere, Egon and Kuppens, Peter and Fried, Eiko I},
  title = {Identifying careless responding in ecological momentary assessment: Inconsistent signals from different detection methods in the WARN-D Data},
  journal = {Psychological Methods},
  year = {2026},
  doi = {10.1037/met0000845}
}
Kostenlos starten →