EUVIMEDScopri EUVIMED
Open access · CC BY 4.0

Overcoming Model Uncertainty — How Equivalence Tests Can Benefit From Model Averaging

Niklas Hagemann, Kathrin Möllenhoff

Statistics in Medicine · 2025

DOI: 10.1002/sim.10309 ↗

At a glance

Journal article in Statistics in Medicine, 2025. Written by Niklas Hagemann and 1 co-authors. Institution: Institute of Medical Statistics and Computational Biology (IMSB), Faculty of Medicine, University of Cologne, Cologne, Germany. Major MEDLINE topics: Models, Statistical, Clinical Trials as Topic. 49 references. The full text is freely available (open access, CC BY 4.0). Funded by: Deutsche Forschungsgemeinschaft.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

A common problem in numerous research areas, particularly in clinical trials, is to test whether the effect of an explanatory variable on an outcome variable is equivalent across different groups. In practice, these tests are frequently used to compare the effect between patient groups, for example, based on gender, age, or treatments. Equivalence is usually assessed by testing whether the difference between the groups does not exceed a pre‐specified equivalence threshold. Classical approaches are based on testing the equivalence of single quantities, for example, the mean, the area under the curve or other values of interest. However, when differences depending on a particular covariate are observed, these approaches can turn out to be not very accurate. Instead, whole regression curves over the entire covariate range, describing for instance the time window or a dose range, are considered and tests are based on a suitable distance measure of two such curves, as, for example, the maximum absolute distance between them. In this regard, a key assumption is that the true underlying regression models are known, which is rarely the case in practice. However, misspecification can lead to severe problems as inflated type I errors or, on the other hand, conservative test procedures. In this paper, we propose a solution to this problem by introducing a flexible extension of such an equivalence test using model averaging in order to overcome this assumption and making the test applicable under model uncertainty. Precisely, we introduce model averaging based on smooth Bayesian information criterion weights and we propose a testing procedure which makes use of the duality between confidence intervals and hypothesis testing. We demonstrate the validity of our approach by means of a simulation study and illustrate its practical relevance considering a time‐response case study with toxicological gene expression data.

Subjects

MeSH terms (MEDLINE)

Models, StatisticalClinical Trials as TopicHumansUncertaintyComputer SimulationRegression AnalysisBayes Theorem

Author keywords

bootstrapdose–response modelsgene expressionmodel averagingmodel‐based equivalence teststime‐response models

Authors and institutions

  • Institute of Medical Statistics and Computational Biology (IMSB), Faculty of Medicine, University of Cologne, Cologne, Germany.

Funding

  • Deutsche Forschungsgemeinschaft

Cite

APA

Hagemann, N., & Möllenhoff, K. (2025). Overcoming Model Uncertainty — How Equivalence Tests Can Benefit From Model Averaging. Statistics in Medicine. https://doi.org/10.1002/sim.10309

Vancouver

Hagemann N, Möllenhoff K. Overcoming Model Uncertainty — How Equivalence Tests Can Benefit From Model Averaging. Statistics in Medicine. 2025. doi:10.1002/sim.10309

BibTeX
@article{Hagemann2025,
  author = {Hagemann, Niklas and Möllenhoff, Kathrin},
  title = {Overcoming Model Uncertainty — How Equivalence Tests Can Benefit From Model Averaging},
  journal = {Statistics in Medicine},
  year = {2025},
  doi = {10.1002/sim.10309}
}
Start for free →