Risk of bias and problematic trials: characterising the research integrity of trials submitted to Anaesthesia
Anaesthesia · 2024
DOI: 10.1111/anae.16411 ↗Kurz gefasst
Fachartikel in der Zeitschrift Anaesthesia, 2024. Verfasst von Paul Bramley und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Anaesthesia, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK. Hauptthemen laut MEDLINE: Randomized Controlled Trials as Topic, Bias, Anesthesiology. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Association of Anaesthetists.
Abstract (Originalsprache)
Background
There is some evidence for systematic biases and failures of research integrity in the anaesthesia literature. However, the features of problematic trials and effect of editorial selection on these issues have not been well quantified.
Methods
We analysed 209 randomised controlled trials submitted to Anaesthesia between 8 March 2019 and 31 March 2020. We evaluated the submitted manuscript, registry data and the results of investigations into the integrity of the trial undertaken at the time of submission. Trials were labelled ‘concerning’ if failures of research integrity were found, and ‘problematic’ if identified issues would have warranted retraction if they had been found after publication. We investigated how ‘problematic’ trials were detected, the distribution of p values and the risk of outcome reporting bias and p‐hacking. We also investigated whether there were any factors that differed in problematic trials.
Results
We found that false data was the most common reason for a trial to be labelled as ‘concerning’, which occurred in 51/62 (82%) cases. We also found that while 195/209 (93%) trials were preregistered, we found adequate registration for only 166/209 (79%) primary outcomes, 100/209 (48%) secondary outcomes and 11/209 (5%) analysis plans. We also found evidence for a step decrease in the frequency of p values > 0.05 compared with p values < 0.05. ‘Problematic’ trials were all single‐centre and appeared to have fewer authors (incident risk ratio (95%CI) 0.8 (0.7–0.9)), but could not otherwise be distinguished reliably from other trials.
Conclusions
Identification of ‘problematic’ trials is frequently dependent on individual patient data, which is often unavailable after publication. Additionally, there is evidence of a risk of outcome reporting bias and p‐hacking in submitted trials. Implementation of alternative research and editorial practices could reduce the risk of bias and make identification of problematic trials easier.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Anaesthesia, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK.
- School of Medicine and Population Health, University of Sheffield, Sheffield, UK.
- Emergency Department, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK.
ORCID-Profile: Paul Bramley
Förderung
- Association of Anaesthetists
Zitieren
APA
Bramley, P., Hulman, J., & Wanstall, H. (2024). Risk of bias and problematic trials: characterising the research integrity of trials submitted to Anaesthesia. Anaesthesia. https://doi.org/10.1111/anae.16411
Vancouver
Bramley P, Hulman J, Wanstall H. Risk of bias and problematic trials: characterising the research integrity of trials submitted to Anaesthesia. Anaesthesia. 2024. doi:10.1111/anae.16411
BibTeX
@article{Bramley2024,
author = {Bramley, Paul and Hulman, Joshua and Wanstall, Helen},
title = {Risk of bias and problematic trials: characterising the research integrity of trials submitted to Anaesthesia},
journal = {Anaesthesia},
year = {2024},
doi = {10.1111/anae.16411}
}
EUVIMED