Meta-regression with categorical moderators and dependent effect sizes: A simulation study
Research Synthesis Methods · 2026-11 · 17 (6) · 1234-1260
DOI: 10.1017/rsm.2026.10092 ↗Kurz gefasst
Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 14.05.2026. Verfasst von Belén Fernández-Castilla und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Methodology of Health and Behavioral Sciences, Faculty of Psychology, https://ror.org/02msb5n36Universidad Nacional de Educación a Dist…. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Universidad Nacional de Educación a Distancia, Fundación Banco Santander, Fundación Séneca.
Abstract (Originalsprache)
Categorical moderators are often found in meta-analysis and examined using meta-regression models. When multiple effect sizes are present within studies, several methods can be used for meta-regression: multivariate models, three-level models, correlated-effects models with robust variance estimation (RVE), three-level models with RVE, and correlated-effects models with RVE and cluster wild bootstrapping (CWB). This study aimed to compare the performance of these methods through a simulation study. Cohen’s d values were generated under a multivariate model, incorporating a binary variable that could represent either study-level or effect size-level characteristics. When the moderator referred to an effect size-level characteristic, its effect was allowed to vary across studies. Factors manipulated in the simulation included number of studies, number of outcomes per study, and the distribution of effect sizes across the categories of the moderator variable, ranging from balanced to highly unbalanced. The methods were applied and compared in terms of bias, Type I error, and power. The results showed that all methods exhibited lower power to detect effects when the moderator variable referred to study-level characteristics and the effect size distribution was very unbalanced. Methods based on RVE (correlated-effects with RVE or with RVE and CWB, and three-level models with RVE) effectively controlled Type I error rates but tended to be overconservative. In contrast, three-level models achieved higher power but at the cost of inflated Type I error. The best balance between Type I error control and power was observed when using a combination of three-level models and RVE.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Methodology of Health and Behavioral Sciences, Faculty of Psychology, https://ror.org/02msb5n36Universidad Nacional de Educación a Distancia, Spain.
- Basic Psychology & Methodology, https://ror.org/03p3aeb86University of Murcia, Spain.
- IMIB-Arrixaca, https://ror.org/053j10c72Murcian Institute of Biomedical Research, Spain.
ORCID-Profile: Belén Fernández-Castilla, José Antonio López-López
Förderung
- Universidad Nacional de Educación a Distancia
- Fundación Banco Santander
- Fundación Séneca
Zitieren
APA
Fernández-Castilla, B., López-López, J. A., & Rubio-Aparicio, M. (2026). Meta-regression with categorical moderators and dependent effect sizes: A simulation study. Research Synthesis Methods, 17(6), 1234-1260. https://doi.org/10.1017/rsm.2026.10092
Vancouver
Fernández-Castilla B, López-López JA, Rubio-Aparicio M. Meta-regression with categorical moderators and dependent effect sizes: A simulation study. Research Synthesis Methods. 2026;17(6):1234-1260. doi:10.1017/rsm.2026.10092
BibTeX
@article{FernndezCastilla2026,
author = {Fernández-Castilla, Belén and López-López, José Antonio and Rubio-Aparicio, María},
title = {Meta-regression with categorical moderators and dependent effect sizes: A simulation study},
journal = {Research Synthesis Methods},
year = {2026},
volume = {17},
number = {6},
pages = {1234--1260},
doi = {10.1017/rsm.2026.10092}
}
EUVIMED