How to Measure the Reliability of Tasks in Experimental Psychology
Journal of Cognition · 18.08.2026 · 9 (1) · 42
DOI: 10.5334/joc.516 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Cognition, online erschienen am 18.08.2026. Verfasst von Marc Brysbaert. Beteiligte Einrichtung: Department of Experimental Psychology, Ghent University, Belgium. Die Arbeit nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Calculating the reliability of experimental tasks can be surprisingly difficult using existing tools. Although R packages such as psych are robust, they often require data in wide format and assume carefully selected items that avoid floor and ceiling effects. To encourage the reporting of task reliability in experimental research, I have written an R function, ICC_participants_long, which uses the intraclass correlation coefficient (ICC) to measure the reliability of participant scores directly from data in long format. Applying this function revealed that the current split-half approach may underestimate the reliability of experimental tasks. Furthermore, the model-based approach makes it possible to generate Best Linear Unbiased Predictions (BLUPs) as estimates of participants’ scores, which provides an informative supplement to the raw means.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Experimental Psychology, Ghent University, Belgium.
ORCID-Profile: Marc Brysbaert
Zitieren
APA
Brysbaert, M. (2026). How to Measure the Reliability of Tasks in Experimental Psychology. Journal of Cognition, 9(1), 42. https://doi.org/10.5334/joc.516
Vancouver
Brysbaert M. How to Measure the Reliability of Tasks in Experimental Psychology. Journal of Cognition. 2026;9(1):42. doi:10.5334/joc.516
BibTeX
@article{Brysbaert2026,
author = {Brysbaert, Marc},
title = {How to Measure the Reliability of Tasks in Experimental Psychology},
journal = {Journal of Cognition},
year = {2026},
volume = {9},
number = {1},
pages = {42},
doi = {10.5334/joc.516}
}
EUVIMED