EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Idiographic interrater reliability measures for intensive longitudinal multirater data

Tobias Koch iD, Miriam F Jaehne iD, Michaela Riediger iD, Antje Rauers iD, Jana Holtmann iD

British Journal of Mathematical and Statistical Psychology · 2026-11 · 79 (3) · 547-568

DOI: 10.1111/bmsp.70022 ↗

Kurz gefasst

Fachartikel in der Zeitschrift British Journal of Mathematical and Statistical Psychology, online erschienen am 20.12.2025. Verfasst von Tobias Koch und 4 weiteren Autor:innen. Beteiligte Einrichtung: Friedrich-Schiller-Universität Jena, Jena, Germany. Hauptthemen laut MEDLINE: Models, Statistical. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Interrater reliability plays a crucial role in various areas of psychology. In this article, we propose a multilevel latent time series model for intensive longitudinal data with structurally different raters (e.g., self‐reports and partner reports). The new MR‐MLTS model enables researchers to estimate idiographic (person‐specific) rater consistency coefficients for contemporaneous or dynamic rater agreement. Additionally, the model allows rater consistency coefficients to be linked to external explanatory or outcome variables. It can be implemented in Mplus as well as in the newly developed R package mlts . We illustrate the model using data from an intensive longitudinal multirater study involving 100 heterosexual couples (200 individuals) assessed across 86 time points. Our findings show that relationship duration and partner cognitive resources positively predict rater consistency for the innovations. Results from a simulation study indicate that the number of time points is critical for accurately estimating idiographic rater consistency coefficients, whereas the number of participants is important for accurately recovering the random effect variances. We discuss advantages, limitations, and future extensions of the MR‐MLTS model.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Models, StatisticalHumansLongitudinal StudiesReproducibility of ResultsObserver VariationPsychometricsComputer SimulationFemaleMaleMultilevel AnalysisSelf Report

Stichwörter der Autor:innen

empathic accuracyidiographic rater consistencylongitudinal structural equation modelingmultirater analysistime series analysis

Autor:innen und Institutionen

  • Friedrich-Schiller-Universität Jena, Jena, Germany.
  • Leipzig University, Leipzig, Germany.

ORCID-Profile: Tobias Koch, Miriam F Jaehne, Michaela Riediger, Antje Rauers, Jana Holtmann

Zitieren

APA

Koch, T., Jaehne, M. F., Riediger, M., Rauers, A., & Holtmann, J. (2026). Idiographic interrater reliability measures for intensive longitudinal multirater data. British Journal of Mathematical and Statistical Psychology, 79(3), 547-568. https://doi.org/10.1111/bmsp.70022

Vancouver

Koch T, Jaehne MF, Riediger M, Rauers A, Holtmann J. Idiographic interrater reliability measures for intensive longitudinal multirater data. British Journal of Mathematical and Statistical Psychology. 2026;79(3):547-568. doi:10.1111/bmsp.70022

BibTeX
@article{Koch2026,
  author = {Koch, Tobias and Jaehne, Miriam F and Riediger, Michaela and Rauers, Antje and Holtmann, Jana},
  title = {Idiographic interrater reliability measures for intensive longitudinal multirater data},
  journal = {British Journal of Mathematical and Statistical Psychology},
  year = {2026},
  volume = {79},
  number = {3},
  pages = {547--568},
  doi = {10.1111/bmsp.70022}
}
Kostenlos starten →