Identifying and managing problematic trials: A research integrity assessment tool for randomized controlled trials in evidence synthesis
Research Synthesis Methods · 2023-05 · 14 (3) · 357-369
DOI: 10.1002/jrsm.1599 ↗Kurz gefasst
Fachartikel in der Zeitschrift Research Synthesis Methods, online erschienen am 15.09.2022. Verfasst von Stephanie Weibel und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, Wuerzburg, Germany. Hauptthemen laut MEDLINE: COVID-19, Scientific Misconduct. Die Arbeit wurde bisher 90-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: NCCIH NIH HHS, National Center for Complementary and Integrative Health, Bundesministerium für Bildung und Forschung.
Abstract (Originalsprache)
Evidence synthesis findings depend on the assumption that the included studies follow good clinical practice and results are not fabricated or false. Studies which are problematic due to scientific misconduct, poor research practice, or honest error may distort evidence synthesis findings. Authors of evidence synthesis need transparent mechanisms to identify and manage problematic studies to avoid misleading findings. As evidence synthesis authors of the Cochrane COVID‐19 review on ivermectin, we identified many problematic studies in terms of research integrity and regulatory compliance. Through iterative discussion, we developed a research integrity assessment (RIA) tool for randomized controlled trials for the update of this Cochrane review. In this paper, we explain the rationale and application of the RIA tool in this case study. RIA assesses six study criteria: study retraction, prospective trial registration, adequate ethics approval, author group, plausibility of methods (e.g., randomization), and plausibility of study results. RIA was used in the Cochrane review as part of the eligibility check during screening of potentially eligible studies. Problematic studies were excluded and studies with open questions were held in awaiting classification until clarified. RIA decisions were made independently by two authors and reported transparently. Using the RIA tool resulted in the exclusion of >40% of studies in the first update of the review. RIA is a complementary tool prior to assessing “Risk of Bias” aiming to establish the integrity and authenticity of studies. RIA provides a platform for urgent development of a standard approach to identifying and managing problematic studies.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, Wuerzburg, Germany.
- Evidence-based Oncology, Department I of Internal Medicine, Center for Integrated Oncology Aachen Bonn Cologne Duesseldorf, Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany.
- Centre for Evidence Synthesis in Global Health, Liverpool School of Tropical Medicine, Liverpool, UK.
- Cochrane Injuries Group, London School of Hygiene & Tropical Medicine, London, UK.
ORCID-Profile: Stephanie Weibel
Förderung
- NCCIH NIH HHS
- National Center for Complementary and Integrative Health
- Bundesministerium für Bildung und Forschung
Zitieren
APA
Weibel, S., Popp, M., Reis, S., Skoetz, N., Garner, P., & Sydenham, E. (2023). Identifying and managing problematic trials: A research integrity assessment tool for randomized controlled trials in evidence synthesis. Research Synthesis Methods, 14(3), 357-369. https://doi.org/10.1002/jrsm.1599
Vancouver
Weibel S, Popp M, Reis S, Skoetz N, Garner P, Sydenham E. Identifying and managing problematic trials: A research integrity assessment tool for randomized controlled trials in evidence synthesis. Research Synthesis Methods. 2023;14(3):357-369. doi:10.1002/jrsm.1599
BibTeX
@article{Weibel2023,
author = {Weibel, Stephanie and Popp, Maria and Reis, Stefanie and Skoetz, Nicole and Garner, Paul and Sydenham, Emma},
title = {Identifying and managing problematic trials: A research integrity assessment tool for randomized controlled trials in evidence synthesis},
journal = {Research Synthesis Methods},
year = {2023},
volume = {14},
number = {3},
pages = {357--369},
doi = {10.1002/jrsm.1599}
}
EUVIMED