Confidence Intervals and Sample Size for the ICC in Two‐Way ANOVA Models
Statistics in Medicine · 2025-05 · 44 (10-12)
DOI: 10.1002/sim.70106 ↗Kurz gefasst
Übersichtsarbeit in der Zeitschrift Statistics in Medicine, online erschienen am 22.05.2025. Verfasst von Dipro Mondal und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Methodology and Statistics, Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, the Netherlands. Hauptthemen laut MEDLINE: Models, Statistical. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nederlandse Organisatie voor Wetenschappelijk Onderzoek.
Abstract (Originalsprache)
The reliability of measurement instruments is vital in fields like medicine and psychology, where these tools are often used for diagnostic purposes. In reliability studies where participants are assessed by the same set of raters, the data can be modeled using a two‐way ANOVA, with the intraclass correlation coefficient (ICC) as a key metric. This paper focuses on the ICC for agreement, which is crucial when the measurement values themselves, rather than just their rank ordering, are of interest. However, selecting appropriate confidence interval methods and determining adequate sample sizes for the ICC for agreement remains challenging. This work advances the understanding of confidence interval methods for the ICC for agreement, provides practical tools, and offers recommendations for selecting confidence interval methods and sample size procedures for planning reliability studies. In particular, we provide a comprehensive review and simulation‐based comparison of six classes of confidence interval methods for the ICC for agreement identified in the literature. Our analysis includes a method based on the F‐distribution, previously omitted, which demonstrates the best statistical properties in some cases. Then, in conjunction with the best‐performing methods, we evaluate three sample size determination procedures based on the expected width of confidence intervals that we identified in the literature. To address the lack of accessible tools, we further developed an interactive R Shiny app, freely available to researchers, to compute confidence intervals and sample sizes. The utility of these methods is illustrated by a study on fetal heart rates.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Methodology and Statistics, Care and Public Health Research Institute (CAPHRI), Maastricht University, Maastricht, the Netherlands.
- Department of Statistics, Computer Science, Applications "Giuseppe Parenti" The University of Florence, Firenze, Italy.
ORCID-Profile: Dipro Mondal, Math J J M Candel, Alberto Cassese, Sophie Vanbelle
Förderung
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
Zitieren
APA
Mondal, D., Candel, M. J. J. M., Cassese, A., & Vanbelle, S. (2025). Confidence Intervals and Sample Size for the ICC in Two‐Way ANOVA Models. Statistics in Medicine, 44(10-12). https://doi.org/10.1002/sim.70106
Vancouver
Mondal D, Candel MJJM, Cassese A, Vanbelle S. Confidence Intervals and Sample Size for the ICC in Two‐Way ANOVA Models. Statistics in Medicine. 2025;44(10-12). doi:10.1002/sim.70106
BibTeX
@article{Mondal2025,
author = {Mondal, Dipro and Candel, Math J J M and Cassese, Alberto and Vanbelle, Sophie},
title = {Confidence Intervals and Sample Size for the ICC in Two‐Way ANOVA Models},
journal = {Statistics in Medicine},
year = {2025},
volume = {44},
number = {10-12},
doi = {10.1002/sim.70106}
}
EUVIMED