Impact of matrix-construction assumptions on quantitative overlap assessment in overviews: A meta-research study
Research Synthesis Methods · 2026-03 · 17 (2) · 348-364
DOI: 10.1017/rsm.2025.10056 ↗Kurz gefasst
Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 17.11.2025. Verfasst von Javier Bracchiglione und 11 weiteren Autor:innen. Beteiligte Einrichtung: Department of Pediatrics, Obstetrics and Gynecology, Preventive Medicine and Public Health, Universitat Autònoma de Barcelona, Spain. Hauptthemen laut MEDLINE: Research Design, Systematic Reviews as Topic. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Overlap of primary studies among multiple systematic reviews (SRs) is a major challenge when conducting overviews. The corrected covered area (CCA) is a metric computed from a matrix of evidence that quantifies overlap. Therefore, the assumptions used to generate the matrix may significantly affect the CCA. We aim to explore how these varying assumptions influence CCA calculations. We searched two databases for intervention-focused overviews published during 2023. Two reviewers conducted study selection and data extraction. We extracted overview characteristics and methods to handle overlap. For seven sampled overviews, we calculated overall and pairwise CCA across 16 scenarios, representing four matrix-construction assumptions. Of 193 included overviews, only 23 (11.9%) adhered to an overview-specific reporting guideline (e.g. PRIOR). Eighty-five (44.0%) did not address overlap; 14 (7.3%) only mentioned it in the discussion; and 94 (48.7%) incorporated it into methods or results (38 using CCA). Among the seven sampled overviews, CCA values varied depending on matrix-construction assumptions, ranging from 1.2% to 13.5% with the overall method and 0.0% to 15.7% with the pairwise method. CCA values may vary depending on the assumptions made during matrix construction, including scope, treatment of structural missingness, and handling of publication threads. This variability calls into question the uncritical use of current CCA thresholds and underscores the need for overview authors to report both overall and pairwise CCA calculations. Our preliminary guidance for transparently reporting matrix-construction assumptions may improve the accuracy and reproducibility of CCA assessments.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Pediatrics, Obstetrics and Gynecology, Preventive Medicine and Public Health, Universitat Autònoma de Barcelona, Spain.
- Iberoamerican Cochrane Centre, Institut de Recerca Sant Pau (IR SANT PAU), CIBERESP, Spain.
- Interdisciplinary Centre for Health Studies (CIESAL), Universidad de Valparaíso, Chile.
- Cochrane Evidence Synthesis Unit Iberoamerica, Iberoamerican Cochrane Centre, Spain.
- Institute for Health Services and Health System Research (IVGF), Faculty of Health Sciences Brandenburg (FGW), Brandenburg Medical School Theodor Fontane, Germany.
- Center for Health Services Research (ZVF-BB), Brandenburg Medical School Theodor Fontane, Germany.
ORCID-Profile: Javier Bracchiglione, Carole Lunny, Fernando Briceño, Roberto Garnham Parra, Xavier Bonfill
Zitieren
APA
Bracchiglione, J., Meza, N., Pieper, D., Lunny, C., Vargas-Peirano, M., Vicuña, J., Briceño, F., Garnham Parra, R., Pérez Carrasco, I., Urrútia, G., Bonfill, X., & Madrid, E. (2026). Impact of matrix-construction assumptions on quantitative overlap assessment in overviews: A meta-research study. Research Synthesis Methods, 17(2), 348-364. https://doi.org/10.1017/rsm.2025.10056
Vancouver
Bracchiglione J, Meza N, Pieper D, Lunny C, Vargas-Peirano M, Vicuña J, et al. Impact of matrix-construction assumptions on quantitative overlap assessment in overviews: A meta-research study. Research Synthesis Methods. 2026;17(2):348-364. doi:10.1017/rsm.2025.10056
BibTeX
@article{Bracchiglione2026,
author = {Bracchiglione, Javier and Meza, Nicolás and Pieper, Dawid and Lunny, Carole and Vargas-Peirano, Manuel and Vicuña, Johanna and Briceño, Fernando and Garnham Parra, Roberto and Pérez Carrasco, Ignacio and Urrútia, Gerard and Bonfill, Xavier and Madrid, Eva},
title = {Impact of matrix-construction assumptions on quantitative overlap assessment in overviews: A meta-research study},
journal = {Research Synthesis Methods},
year = {2026},
volume = {17},
number = {2},
pages = {348--364},
doi = {10.1017/rsm.2025.10056}
}
EUVIMED