EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Rating Down for Publication Bias is Rare in Cochrane Reviews: A Descriptive Study

Markus Toews, Silvia Minozzi, Bernardine H Stegeman, Michela Cinquini, Joerg J Meerpohl, Kenneth Färnqvist iD, Matteo Bruschettini, Ingrid Toews iD

Cochrane Evidence Synthesis and Methods · 2026-07 · 4 (4)

DOI: 10.1002/cesm.70089 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cochrane Evidence Synthesis and Methods, online erschienen am 21.07.2026. Verfasst von Markus Toews und 7 weiteren Autor:innen. Beteiligte Einrichtung: Institute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine University of Freiburg Freiburg Germany. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Publication bias impacts the direction and magnitude of summary effect estimates in systematic reviews and the confidence in the review findings. It remains unclear to what degree publication bias is considered in the certainty assessments in systematic reviews. Our research aims are to generate an overview of and estimate how frequent rating down occurs for the GRADE domain “publication bias” across Cochrane reviews. Study Design and Setting This is a descriptive study. We included Cochrane reviews published between January 2021 and October 2023 that included at least one outcome for which the certainty of evidence was rated down for publication bias. We collected data from the reviews' full text, analyses, and figures. We analyzed data with descriptive statistical analysis. We used a deductive qualitative approach for analyzing qualitative data.

Results

We identified 81 reviews. These reviews included between 1 and 328 individual studies. All but three reviews included randomized‐controlled trials only. Data from less than 10 studies supported the summary of findings of 106 outcomes. The most commonly used methods for detecting publication bias were funnel plots. 220 outcomes were rated down by one level for publication bias. Four outcomes were rated down by two levels. The most commonly reported reasons were indications of publication bias in funnel plots.

Conclusions

Rating down for publication bias was rare in Cochrane reviews despite the high prevalence of publication bias in original research. Guidance might not suffice to inform assessments of publication bias in reviews with less than 10 studies.

Schlagwörter

Stichwörter der Autor:innen

GRADEdissemination biasmeta‐researchpublication biasresearch on researchsystematic reviews

Autor:innen und Institutionen

  • Institute for Evidence in Medicine, Medical Center-University of Freiburg, Faculty of Medicine University of Freiburg Freiburg Germany.
  • Laboratory of Methodology of Systematic Reviews and Guidelines Production Istituto di Ricerche Farmacologiche Mario Negri IRCCS Milan Italy.
  • Knowledge Institute of the Dutch Association of Medical Specialists Utrecht the Netherlands.
  • Cochrane Germany, Cochrane Germany Foundation Freiburg Germany.
  • Department of Molecular Medicine and Surgery Karolinska Institute Solna Sweden.
  • Cochrane Sweden, Department of Research, Development, Education and Innovation, Skåne University Hospital Lund University Lund Sweden.

ORCID-Profile: Kenneth Färnqvist, Ingrid Toews

Zitieren

APA

Toews, M., Minozzi, S., Stegeman, B. H., Cinquini, M., Meerpohl, J. J., Färnqvist, K., Bruschettini, M., & Toews, I. (2026). Rating Down for Publication Bias is Rare in Cochrane Reviews: A Descriptive Study. Cochrane Evidence Synthesis and Methods, 4(4). https://doi.org/10.1002/cesm.70089

Vancouver

Toews M, Minozzi S, Stegeman BH, Cinquini M, Meerpohl JJ, Färnqvist K, et al. Rating Down for Publication Bias is Rare in Cochrane Reviews: A Descriptive Study. Cochrane Evidence Synthesis and Methods. 2026;4(4). doi:10.1002/cesm.70089

BibTeX
@article{Toews2026,
  author = {Toews, Markus and Minozzi, Silvia and Stegeman, Bernardine H and Cinquini, Michela and Meerpohl, Joerg J and Färnqvist, Kenneth and Bruschettini, Matteo and Toews, Ingrid},
  title = {Rating Down for Publication Bias is Rare in Cochrane Reviews: A Descriptive Study},
  journal = {Cochrane Evidence Synthesis and Methods},
  year = {2026},
  volume = {4},
  number = {4},
  doi = {10.1002/cesm.70089}
}
Kostenlos starten →