EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

How to Measure the Reliability of Tasks in Experimental Psychology

Marc Brysbaert iD

Journal of Cognition · 18.08.2026 · 9 (1) · 42

DOI: 10.5334/joc.516 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Cognition, online erschienen am 18.08.2026. Verfasst von Marc Brysbaert. Beteiligte Einrichtung: Department of Experimental Psychology, Ghent University, Belgium. Die Arbeit nennt 28 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Calculating the reliability of experimental tasks can be surprisingly difficult using existing tools. Although R packages such as psych are robust, they often require data in wide format and assume carefully selected items that avoid floor and ceiling effects. To encourage the reporting of task reliability in experimental research, I have written an R function, ICC_participants_long, which uses the intraclass correlation coefficient (ICC) to measure the reliability of participant scores directly from data in long format. Applying this function revealed that the current split-half approach may underestimate the reliability of experimental tasks. Furthermore, the model-based approach makes it possible to generate Best Linear Unbiased Predictions (BLUPs) as estimates of participants’ scores, which provides an informative supplement to the raw means.

Schlagwörter

Stichwörter der Autor:innen

R functionintraclass correlation coefficienttask reliability

Autor:innen und Institutionen

  • Department of Experimental Psychology, Ghent University, Belgium.

ORCID-Profile: Marc Brysbaert

Zitieren

APA

Brysbaert, M. (2026). How to Measure the Reliability of Tasks in Experimental Psychology. Journal of Cognition, 9(1), 42. https://doi.org/10.5334/joc.516

Vancouver

Brysbaert M. How to Measure the Reliability of Tasks in Experimental Psychology. Journal of Cognition. 2026;9(1):42. doi:10.5334/joc.516

BibTeX
@article{Brysbaert2026,
  author = {Brysbaert, Marc},
  title = {How to Measure the Reliability of Tasks in Experimental Psychology},
  journal = {Journal of Cognition},
  year = {2026},
  volume = {9},
  number = {1},
  pages = {42},
  doi = {10.5334/joc.516}
}
Kostenlos starten →