Trustworthiness assessment as an inclusion criterion for systematic reviews—What is the impact on results?
Cochrane Evidence Synthesis and Methods · 2023-12 · 1 (10)
DOI: 10.1002/cesm.12037 ↗Kurz gefasst
Fachartikel in der Zeitschrift Cochrane Evidence Synthesis and Methods, online erschienen am 13.12.2023. Verfasst von Jo Weeks und 2 weiteren Autor:innen. Beteiligte Einrichtung: Cochrane Pregnancy and Childbirth Group University of Liverpool Liverpool UK. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
There is increasing concern that a significant proportion of randomized controlled trials (RCTs) included in Cochrane reviews may not be trustworthy. Applying the Cochrane Pregnancy and Childbirth Trustworthiness Screening Tool (CPC‐TST) has already had a clinically important effect on several reviews published by the Cochrane Pregnancy and Childbirth Group.
Objectives
We wanted to assess the impact of removing untrustworthy RCTs from already‐published Cochrane reviews on a defined clinical area (antenatal and postnatal nutritional interventions).
Methods
We applied the tool to 18 Cochrane reviews (374 RCTs). The tool had four domains: (i) is the research governance trustworthy; (ii) are the baseline characteristics trustworthy; (iii) is the study feasible; (iv) are the results plausible? When additional information was needed, authors were contacted using a standard template. At least two attempts were made to contact the authors. At the end of the evaluation process each study was classified as: (i) included (YES to all questions); (ii) excluded (retracted study); or (iii) awaiting classification (any NO to the questions).
Results
Ninety‐three out of 374 included studies (25%) were reclassified as “excluded” or “awaiting classification.” The number of included RCTs was reduced in 14 out of 18 reviews. Six reviews (33%) were judged to require updating because of important differences in the Summary of Findings tables (direction and size of effects and/or GRADE ratings), conclusions, implication for practice, and/or implication for research.
Conclusions
Formal assessment of trustworthiness, and inclusion only of studies that satisfy prespecified criteria for trustworthiness, affect conclusions in a relatively large number of Cochrane reviews, with potentially important clinical implications for practice and research.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Cochrane Pregnancy and Childbirth Group University of Liverpool Liverpool UK.
ORCID-Profile: Jo Weeks, Anna Cuthbert, Zarko Alfirevic
Zitieren
APA
Weeks, J., Cuthbert, A., & Alfirevic, Z. (2023). Trustworthiness assessment as an inclusion criterion for systematic reviews—What is the impact on results?. Cochrane Evidence Synthesis and Methods, 1(10). https://doi.org/10.1002/cesm.12037
Vancouver
Weeks J, Cuthbert A, Alfirevic Z. Trustworthiness assessment as an inclusion criterion for systematic reviews—What is the impact on results?. Cochrane Evidence Synthesis and Methods. 2023;1(10). doi:10.1002/cesm.12037
BibTeX
@article{Weeks2023,
author = {Weeks, Jo and Cuthbert, Anna and Alfirevic, Zarko},
title = {Trustworthiness assessment as an inclusion criterion for systematic reviews—What is the impact on results?},
journal = {Cochrane Evidence Synthesis and Methods},
year = {2023},
volume = {1},
number = {10},
doi = {10.1002/cesm.12037}
}
EUVIMED