A re‐analysis of 150 women's health trials to investigate how the Bayesian approach may offer a solution to the misinterpretation of statistical findings
BJOG: An International Journal of Obstetrics & Gynaecology · 2023-12 · 130 (13) · 1629-1638
DOI: 10.1111/1471-0528.17570 ↗Kurz gefasst
Fachartikel in der Zeitschrift BJOG: An International Journal of Obstetrics & Gynaecology, online erschienen am 28.06.2023. Verfasst von Karla Hemming und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Applied Health Research, University of Birmingham, Birmingham, UK. Hauptthemen laut MEDLINE: Women's Health. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: UK NIHR Collaborations for Leadership in Applied Health Research and Care West Midlands initiative.
Abstract (Originalsprache)
Objective
To investigate whether a Bayesian interpretation might help prevent misinterpretation of statistical findings and support authors to differentiate evidence of no effect from statistical uncertainty.
Design
A Bayesian re‐analysis to determine posterior probabilities of clinically important effects (e.g., a large effect is set at a 4 percentage point difference and a trivial effect to be within a 0.5 percentage point difference). Posterior probabilities greater than 95% are considered as strong statistical evidence, and less than 95% as inconclusive. Sample 150 major women's health trials with binary outcomes. Main Outcome Measures Posterior probabilities of large, moderate, small and trivial effects.
Results
Under frequentist methods, 48 (32%) were statistically significant ( p ‐value ≤ 0.05) and 102 (68%) statistically non‐significant. The frequentist and Bayesian point estimates and confidence intervals showed strong concordance. Of the statistically non‐significant trials ( n = 102), the Bayesian approach classified the majority (94, 92%) as inconclusive, neither able to confirm or refute effectiveness. A small number of statistically non‐significant findings (8, 8%) were classified as having strong statistical evidence of an effect.
Conclusions
Whilst almost all trials report confidence intervals, in practice most statistical findings are interpreted on the basis of statistical significance, mostly concluding evidence of no effect. Findings here suggest the majority are likely uncertain. A Bayesian approach could help differentiate evidence of no effect from statistical uncertainty.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of Applied Health Research, University of Birmingham, Birmingham, UK.
- Tommy's National Centre for Miscarriage Research, Institute of Metabolism and Systems Research, College of Medical and Dental Sciences, University of Birmingham, Edgbaston, UK.
- School of Epidemiology and Public Health, University of Ottawa, Ottawa, Ontario, Canada.
- OMNI Research Group, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
- Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Ontario, Canada.
- School of Epidemiology, Public Health and Preventive Medicine, University of Ottawa, Ottawa, Ontario, Canada.
Förderung
- UK NIHR Collaborations for Leadership in Applied Health Research and Care West Midlands initiative
Zitieren
APA
Hemming, K., Melo, P., Luo, R., Taljaard, M., & Coomarasamy, A. (2023). A re‐analysis of 150 women's health trials to investigate how the Bayesian approach may offer a solution to the misinterpretation of statistical findings. BJOG: An International Journal of Obstetrics & Gynaecology, 130(13), 1629-1638. https://doi.org/10.1111/1471-0528.17570
Vancouver
Hemming K, Melo P, Luo R, Taljaard M, Coomarasamy A. A re‐analysis of 150 women's health trials to investigate how the Bayesian approach may offer a solution to the misinterpretation of statistical findings. BJOG: An International Journal of Obstetrics & Gynaecology. 2023;130(13):1629-1638. doi:10.1111/1471-0528.17570
BibTeX
@article{Hemming2023,
author = {Hemming, Karla and Melo, Pedro and Luo, Rong and Taljaard, Monica and Coomarasamy, Arri},
title = {A re‐analysis of 150 women's health trials to investigate how the Bayesian approach may offer a solution to the misinterpretation of statistical findings},
journal = {BJOG: An International Journal of Obstetrics & Gynaecology},
year = {2023},
volume = {130},
number = {13},
pages = {1629--1638},
doi = {10.1111/1471-0528.17570}
}
EUVIMED