EUVIMEDOntdek EUVIMED
Open access · CC BY-NC-ND 4.0

Bayesian safety surveillance with adaptive bias correction

Fan Bu iD, Martijn J Schuemie iD, Akihiko Nishimura, Louisa H Smith, Kristin Kostka, Thomas Falconer, Jody-Ann McLeggon, Patrick B Ryan, George Hripcsak, Marc A Suchard

Statistics in Medicine · 2024

DOI: 10.1002/sim.9968 ↗

At a glance

Journal article in Statistics in Medicine, 2024. Written by Fan Bu and 9 co-authors. Institution: Department of Biostatistics, University of California, Los Angeles, California, USA. Major MEDLINE topics: Adverse Drug Reaction Reporting Systems, Vaccines, Product Surveillance, Postmarketing. Cited 5 times so far (Crossref); 60 references. The full text is freely available (open access, CC BY-NC-ND 4.0). Funded by: NIA NIH HHS, NLM NIH HHS, Common Fund.

SamenvattingSubjectsBibliografische gegevensCiteRelated studies

Abstract (original language)

Postmarket safety surveillance is an integral part of mass vaccination programs. Typically relying on sequential analysis of real‐world health data as they accrue, safety surveillance is challenged by sequential multiple testing and by biases induced by residual confounding in observational data. The current standard approach based on the maximized sequential probability ratio test (MaxSPRT) fails to satisfactorily address these practical challenges and it remains a rigid framework that requires prespecification of the surveillance schedule. We develop an alternative Bayesian surveillance procedure that addresses both aforementioned challenges using a more flexible framework. To mitigate bias, we jointly analyze a large set of negative control outcomes that are adverse events with no known association with the vaccines in order to inform an empirical bias distribution, which we then incorporate into estimating the effect of vaccine exposure on the adverse event of interest through a Bayesian hierarchical model. To address multiple testing and improve on flexibility, at each analysis timepoint, we update a posterior probability in favor of the alternative hypothesis that vaccination induces higher risks of adverse events, and then use it for sequential detection of safety signals. Through an empirical evaluation using six US observational healthcare databases covering more than 360 million patients, we benchmark the proposed procedure against MaxSPRT on testing errors and estimation accuracy, under two epidemiological designs, the historical comparator and the self‐controlled case series. We demonstrate that our procedure substantially reduces Type 1 error rates, maintains high statistical power and fast signal detection, and provides considerably more accurate estimation than MaxSPRT. Given the extensiveness of the empirical study which yields more than 7 million sets of results, we present all results in a public R ShinyApp. As an effort to promote open science, we provide full implementation of our method in the open‐source R package EvidenceSynthesis .

Subjects

MeSH terms (MEDLINE)

Adverse Drug Reaction Reporting SystemsVaccinesProduct Surveillance, PostmarketingHumansBayes TheoremBiasProbability

Author keywords

Bayesian sequential testingpostmarket safety surveillancereal-world evidencesystematic error

Substances

Vaccines

Authors and institutions

  • Department of Biostatistics, University of California, Los Angeles, California, USA.
  • Department of Biostatistics, University of Michigan-Ann Arbor, Ann Arbor, Michigan, USA.
  • Janssen Research and Development, Raritan, New Jersey, USA.
  • Department of Biostatistics, Bloomberg School of Public Health, Johns Hopkins University, Baltimore, Maryland, USA.
  • Department of Health Sciences, Northeastern University, Portland, Maine, USA.
  • The OHDSI Center at the Roux Institute, Northeastern University, Portland, Maine, USA.

ORCID profiles: Fan Bu, Martijn J Schuemie

Funding

  • NIA NIH HHS
  • NLM NIH HHS
  • Common Fund

Cite

APA

Bu, F., Schuemie, M. J., Nishimura, A., Smith, L. H., Kostka, K., Falconer, T., McLeggon, J. A., Ryan, P. B., Hripcsak, G., & Suchard, M. A. (2024). Bayesian safety surveillance with adaptive bias correction. Statistics in Medicine. https://doi.org/10.1002/sim.9968

Vancouver

Bu F, Schuemie MJ, Nishimura A, Smith LH, Kostka K, Falconer T, et al. Bayesian safety surveillance with adaptive bias correction. Statistics in Medicine. 2024. doi:10.1002/sim.9968

BibTeX
@article{Bu2024,
  author = {Bu, Fan and Schuemie, Martijn J and Nishimura, Akihiko and Smith, Louisa H and Kostka, Kristin and Falconer, Thomas and McLeggon, Jody-Ann and Ryan, Patrick B and Hripcsak, George and Suchard, Marc A},
  title = {Bayesian safety surveillance with adaptive bias correction},
  journal = {Statistics in Medicine},
  year = {2024},
  doi = {10.1002/sim.9968}
}
Start for free →