Assessing the magnitude of changes from protocol to publication—a survey on Cochrane and non-Cochrane Systematic Reviews
PeerJ · 02.10.2023 · 11 · e16016
DOI: 10.7717/peerj.16016 ↗Kurz gefasst
Studienprotokoll in der Zeitschrift PeerJ, online erschienen am 02.10.2023. Verfasst von Maximilian Siebert und 5 weiteren Autor:innen. Beteiligte Einrichtung: Stanford University, Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA. Hauptthemen laut MEDLINE: Systematic Reviews as Topic, Publishing. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objective
To explore differences between published reviews and their respective protocols in a sample of 97 non-Cochrane Systematic Reviews (non-CSRs) and 97 Cochrane Systematic Reviews (CSRs) in terms of PICOS (Patients/Population, Intervention, Comparison/Control, Outcome, Study type) elements and the extent to which they were reported. Study Design and Setting We searched PubMed and Cochrane databases to identify non-CSRs and CSRs that were published in 2018. We then searched for their corresponding Cochrane or PROSPERO protocols. The published reviews were compared to their protocols. The primary outcome was changes from protocol to review in terms of PICOS elements.
Results
We identified a total of 227 changes from protocol to review in PICOS elements, 1.11 (Standard Deviation (SD), 1.22) changes per review for CSRs and 1.23 (SD, 1.12) for non-CSRs per review. More than half of each sub-sample (54.6% of CSRs and 67.0% of non-CSRs) (Absolute Risk Reduction (ARR) 12.4% [−1.3%; 26.0%]) had changes in PICOS elements. For both subsamples, approximately a third of all changes corresponded to changes related to primary outcomes. Marked differences were found between the sub-samples for the reporting of changes. 95.8% of the changes in PICOS items were not reported in the non-CSRs compared to 42.6% in the CSRs (ARR 53.2% [43.2%; 63.2%]).
Conclusion
CSRs showed better results than non-CSRs in terms of the reporting of changes. Reporting of changes from protocol needs to be promoted and requires general improvement. The limitations of this study lie in its observational design. Registration: https://osf.io/6j8gd/ .
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Stanford University, Meta-Research Innovation Center at Stanford (METRICS), Stanford University, Stanford, CA, USA.
- Université de Rennes, Univ Rennes, CHU Rennes, Inserm, Centre d'investigation clinique de Rennes (CIC1414), Service de pharmacologie clinique, Institut de recherche en santé, environnement et travail (Irset), UMR S 1085…
- Faculty of Dentistry at the University of Cartagena, Department of Research, Cartagena, Colombia.
- Universidad de Valparaíso, Interdisciplinary Centre for Health Studies (CIESAL), Valparaíso, Chile.
- Institut Universitaire de France, Paris, France.
- Sant Pau Biomedical Research Institute (IIB-Sant Pau), Iberoamerican Cochrane Centre, Barcelona, Spain.
Zitieren
APA
Siebert, M., Caquelin, L., Madera, M., Acosta-Dighero, R., Naudet, F., & Roqué, M. (2023). Assessing the magnitude of changes from protocol to publication—a survey on Cochrane and non-Cochrane Systematic Reviews. PeerJ, 11, e16016. https://doi.org/10.7717/peerj.16016
Vancouver
Siebert M, Caquelin L, Madera M, Acosta-Dighero R, Naudet F, Roqué M. Assessing the magnitude of changes from protocol to publication—a survey on Cochrane and non-Cochrane Systematic Reviews. PeerJ. 2023;11:e16016. doi:10.7717/peerj.16016
BibTeX
@article{Siebert2023,
author = {Siebert, Maximilian and Caquelin, Laura and Madera, Meisser and Acosta-Dighero, Roberto and Naudet, Florian and Roqué, Marta},
title = {Assessing the magnitude of changes from protocol to publication—a survey on Cochrane and non-Cochrane Systematic Reviews},
journal = {PeerJ},
year = {2023},
volume = {11},
pages = {e16016},
doi = {10.7717/peerj.16016}
}
EUVIMED