EUVIMEDSkopri EUVIMED
Open access · CC BY 4.0

Optimal Weighted Tests for Replication Studies and the ‘Two‐Trials Rule’ With Multiple Hypotheses

David S Robertson iD, Thomas Jaki

Statistics in Medicine · 2026-07 · 45 (15-17)

DOI: 10.1002/sim.70638 ↗

At a glance

Journal article in Statistics in Medicine, published online on 2026-07-01. Written by David S Robertson and 1 co-authors. Institution: MRC Biostatistics Unit, University of Cambridge, Cambridge, UK. Major MEDLINE topics: Clinical Trials as Topic. Cited 1 times so far (Crossref); 25 references. The full text is freely available (open access, CC BY 4.0).

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Replication studies for scientific research are an important part of ensuring the reliability and integrity of experimental findings. In the context of clinical trials, the concept of replication has been formalized by the “two‐trials” rule, where two pivotal studies are required to show positive results before a drug can be approved. In experiments testing multiple hypotheses simultaneously, control of the overall familywise error rate (FWER) is additionally required in many contexts. The well‐known Bonferroni procedure controls the FWER, and a natural extension is to introduce weights into this procedure to reflect the a‐priori importance of hypotheses or to maximize some measure of the overall power of the experiment. In this article, we consider analyzing a replication study using an optimal weighted Bonferroni procedure, with the weights based on the results of the original study that is being replicated and the optimality criterion being to maximize the disjunctive power of the trial (the power to reject at least one non‐null hypothesis). We show that using the proposed procedure can lead to a substantial increase in the probability of success (PoS), is robust to changes in the effect sizes between the two studies, and recovers the submission wise type I error rate of the two‐trials rule.

Subjects

MeSH terms (MEDLINE)

Clinical Trials as TopicHumansReproducibility of ResultsModels, StatisticalComputer SimulationResearch DesignData Interpretation, Statistical

Author keywords

familywise error ratepowerreproducibilitytype I error rate control

Authors and institutions

  • MRC Biostatistics Unit, University of Cambridge, Cambridge, UK.
  • University of Regensburg, Regensburg, Germany.

ORCID profiles: David S Robertson

Cite

APA

Robertson, D. S., & Jaki, T. (2026). Optimal Weighted Tests for Replication Studies and the ‘Two‐Trials Rule’ With Multiple Hypotheses. Statistics in Medicine, 45(15-17). https://doi.org/10.1002/sim.70638

Vancouver

Robertson DS, Jaki T. Optimal Weighted Tests for Replication Studies and the ‘Two‐Trials Rule’ With Multiple Hypotheses. Statistics in Medicine. 2026;45(15-17). doi:10.1002/sim.70638

BibTeX
@article{Robertson2026,
  author = {Robertson, David S and Jaki, Thomas},
  title = {Optimal Weighted Tests for Replication Studies and the ‘Two‐Trials Rule’ With Multiple Hypotheses},
  journal = {Statistics in Medicine},
  year = {2026},
  volume = {45},
  number = {15-17},
  doi = {10.1002/sim.70638}
}
Start for free →