Careless Responding in Daily Diary Research: Detection and Impact on Intensive Longitudinal Data Analyses
Journal of Behavioral Data Science · 03.07.2026 · 6 (2) · 1-24
DOI: 10.35566/jbds/wang2026 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Behavioral Data Science, online erschienen am 03.07.2026. Verfasst von Lijuan Wang und 10 weiteren Autor:innen.
Abstract (Originalsprache)
Careless responding is a concern in online surveys and poses a threat to data quality in intensive longitudinal research, which often relies on repeated online surveys. Despite its potential impact, little research has examined careless responding in adolescent daily diary research. This study investigated the prevalence, trends, and baseline correlates of careless responding using two daily attention check (ACQ) questions and response time data in a 21-day daily diary study of 311 youths aged 12 to 16. Average compliance (75.1%) and careless responding rates (3.4% to 18.1%) were comparable to those reported in recent meta-analyses with adult samples, supporting the feasibility of collecting 21-day daily diaries from adolescents. Response time screening using the common 2-second-per-item rule was less sensitive than ACQs in detecting careless responding in adolescent daily diaries. Participants failed the second ACQ more frequently than the first, highlighting both the value of multiple ACQs per assessment and the potential benefit of shorter surveys. Younger adolescents and those with higher state anger, more neighborhood problems, lower anger control, and poorer emotion regulation were more likely to fail ACQs. Sensitivity analyses using various subsamples after removing careless responding cases suggested that longitudinal analysis results may be inflated when careless responding is not addressed. Our findings underscore the importance of incorporating attention check and response time measures and conducting sensitivity analyses to examine the robustness of statistical conclusions in intensive longitudinal research with youth.
Zitieren
APA
Wang, L., Yip, T., Fang, Y., Li, R., Lorenzo, K., Park, I. J. K., Valentino, K., Cruz-Gonzalez, M., Zhen-Duan, J., Alvarez, K., & Alegría, M. (2026). Careless Responding in Daily Diary Research: Detection and Impact on Intensive Longitudinal Data Analyses. Journal of Behavioral Data Science, 6(2), 1-24. https://doi.org/10.35566/jbds/wang2026
Vancouver
Wang L, Yip T, Fang Y, Li R, Lorenzo K, Park IJK, et al. Careless Responding in Daily Diary Research: Detection and Impact on Intensive Longitudinal Data Analyses. Journal of Behavioral Data Science. 2026;6(2):1-24. doi:10.35566/jbds/wang2026
BibTeX
@article{Wang2026,
author = {Wang, Lijuan and Yip, Tiffany and Fang, Yuan and Li, Ruoxuan and Lorenzo, Kyle and Park, Irene J. K. and Valentino, Kristin and Cruz-Gonzalez, Mario and Zhen-Duan, Jenny and Alvarez, Kiara and Alegría, Margarita},
title = {Careless Responding in Daily Diary Research: Detection and Impact on Intensive Longitudinal Data Analyses},
journal = {Journal of Behavioral Data Science},
year = {2026},
volume = {6},
number = {2},
pages = {1--24},
doi = {10.35566/jbds/wang2026}
}
EUVIMED