EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Risk of bias and problematic trials: characterising the research integrity of trials submitted to Anaesthesia

Paul Bramley iD, Joshua Hulman, Helen Wanstall

Anaesthesia · 2024

DOI: 10.1111/anae.16411 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Anaesthesia, 2024. Verfasst von Paul Bramley und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Anaesthesia, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK. Hauptthemen laut MEDLINE: Randomized Controlled Trials as Topic, Bias, Anesthesiology. Die Arbeit nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Association of Anaesthetists.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

There is some evidence for systematic biases and failures of research integrity in the anaesthesia literature. However, the features of problematic trials and effect of editorial selection on these issues have not been well quantified.

Methods

We analysed 209 randomised controlled trials submitted to Anaesthesia between 8 March 2019 and 31 March 2020. We evaluated the submitted manuscript, registry data and the results of investigations into the integrity of the trial undertaken at the time of submission. Trials were labelled ‘concerning’ if failures of research integrity were found, and ‘problematic’ if identified issues would have warranted retraction if they had been found after publication. We investigated how ‘problematic’ trials were detected, the distribution of p values and the risk of outcome reporting bias and p‐hacking. We also investigated whether there were any factors that differed in problematic trials.

Results

We found that false data was the most common reason for a trial to be labelled as ‘concerning’, which occurred in 51/62 (82%) cases. We also found that while 195/209 (93%) trials were preregistered, we found adequate registration for only 166/209 (79%) primary outcomes, 100/209 (48%) secondary outcomes and 11/209 (5%) analysis plans. We also found evidence for a step decrease in the frequency of p values > 0.05 compared with p values < 0.05. ‘Problematic’ trials were all single‐centre and appeared to have fewer authors (incident risk ratio (95%CI) 0.8 (0.7–0.9)), but could not otherwise be distinguished reliably from other trials.

Conclusions

Identification of ‘problematic’ trials is frequently dependent on individual patient data, which is often unavailable after publication. Additionally, there is evidence of a risk of outcome reporting bias and p‐hacking in submitted trials. Implementation of alternative research and editorial practices could reduce the risk of bias and make identification of problematic trials easier.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Randomized Controlled Trials as TopicBiasAnesthesiologyHumansAnesthesiaResearch DesignPublication Bias

Stichwörter der Autor:innen

publication biasquestionable research practicesrandomised controlled trialsresearch integrity

Autor:innen und Institutionen

  • Department of Anaesthesia, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK.
  • School of Medicine and Population Health, University of Sheffield, Sheffield, UK.
  • Emergency Department, Sheffield Teaching Hospitals NHS Foundation Trust, Sheffield, UK.

ORCID-Profile: Paul Bramley

Förderung

  • Association of Anaesthetists

Zitieren

APA

Bramley, P., Hulman, J., & Wanstall, H. (2024). Risk of bias and problematic trials: characterising the research integrity of trials submitted to Anaesthesia. Anaesthesia. https://doi.org/10.1111/anae.16411

Vancouver

Bramley P, Hulman J, Wanstall H. Risk of bias and problematic trials: characterising the research integrity of trials submitted to Anaesthesia. Anaesthesia. 2024. doi:10.1111/anae.16411

BibTeX
@article{Bramley2024,
  author = {Bramley, Paul and Hulman, Joshua and Wanstall, Helen},
  title = {Risk of bias and problematic trials: characterising the research integrity of trials submitted to Anaesthesia},
  journal = {Anaesthesia},
  year = {2024},
  doi = {10.1111/anae.16411}
}
Kostenlos starten →