Synthesis challenges in complex evidence: A critical analysis of systematic reviews of face mask efficacy
Research Synthesis Methods · 2026-07 · 17 (4) · 714-733
DOI: 10.1017/rsm.2026.10072 ↗Kurz gefasst
Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 06.02.2026. Verfasst von Trisha Greenhalgh und 4 weiteren Autor:innen. Beteiligte Einrichtung: Nuffield Department of Primary Care Health Sciences, University of Oxford, UK. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 75 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: UK Research and Innovation.
Abstract (Originalsprache)
The evaluation of the role of face masks in preventing respiratory infections is a paradigm case in synthesising complex evidence (i.e. extensive, diverse, technically specialised, and with multilevel chains of causality). Primary studies have assessed different mask types, diseases, populations, and settings using different research designs. Numerous review teams have attempted to synthesise this literature, in which observational (case–control, cohort, cross-sectional) and ecological studies predominate. Their findings and conclusions vary widely. This article critically examines how 66 systematic reviews dealt with mask efficacy studies. Risk-of-bias tools produced unreliable assessments when—as was often the case—review teams lacked methodological expertise or topic-specific understanding. This was especially true when datasets were large and heterogeneous, with multiple biases playing out in different ways and requiring nuanced adjustments. In such circumstances, tools were sometimes used crudely and reductively rather than to support close reading of primary studies and guide expert judgments. Various moves by reviewers—excluding observational evidence altogether, assessing risk but not direction of biases, omitting distinguishing details of primary studies, and producing meta-analyses that combined studies of different designs or included studies at critical risk of bias—served to obscure important aspects of heterogeneity, resulting in bland and unhelpful summary statements. We draw on philosophy to question the formulaic use of generic risk-of-bias tools, especially when the primary evidence demands expert understanding and tailoring of study quality questions to the topic. We call for more rigorous training and oversight of reviewers of complex evidence and for new review methods designed specifically for such evidence.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Nuffield Department of Primary Care Health Sciences, University of Oxford, UK.
- Philosophy, University of Manchester - The Victoria University of Manchester Campus, UK.
- Law, University of Exeter, UK.
ORCID-Profile: Trisha Greenhalgh, Jon Williamson
Förderung
- UK Research and Innovation
Zitieren
APA
Greenhalgh, T., Ratnayake, S., Helm, R., Poliseli, L., & Williamson, J. (2026). Synthesis challenges in complex evidence: A critical analysis of systematic reviews of face mask efficacy. Research Synthesis Methods, 17(4), 714-733. https://doi.org/10.1017/rsm.2026.10072
Vancouver
Greenhalgh T, Ratnayake S, Helm R, Poliseli L, Williamson J. Synthesis challenges in complex evidence: A critical analysis of systematic reviews of face mask efficacy. Research Synthesis Methods. 2026;17(4):714-733. doi:10.1017/rsm.2026.10072
BibTeX
@article{Greenhalgh2026,
author = {Greenhalgh, Trisha and Ratnayake, Sahanika and Helm, Rebecca and Poliseli, Luana and Williamson, Jon},
title = {Synthesis challenges in complex evidence: A critical analysis of systematic reviews of face mask efficacy},
journal = {Research Synthesis Methods},
year = {2026},
volume = {17},
number = {4},
pages = {714--733},
doi = {10.1017/rsm.2026.10072}
}
EUVIMED