Selective randomization inference for adaptive experiments
Journal of the Royal Statistical Society Series B: Statistical Methodology · 08.06.2026
DOI: 10.1093/jrsssb/qkag081 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the Royal Statistical Society Series B: Statistical Methodology, online erschienen am 08.06.2026. Verfasst von Tobias Freidling und 2 weiteren Autor:innen. Die Arbeit nennt 84 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: GlaxoSmithKline Research & Development Limited, Engineering and Physical Sciences Research Council.
Abstract (Originalsprache)
Adaptive experiments use preliminary analyses of the data to inform further course of action and are commonly used in many disciplines including medical and social sciences. Because the null hypothesis and experimental design are data-dependent, it has long been recognized that statistical inference for adaptive experiments is not straightforward. Most existing methods only apply to specific adaptive designs and rely on strong assumptions. In this work, we propose selective randomization inference as a general framework for analysing adaptive experiments. In a nutshell, our approach applies conditional postselection inference to randomization tests. By using directed acyclic graphs to describe the data generating process, we derive a selective randomization p-value that controls the selective type-I error. As inference only relies on the randomness in the treatment assignment, no modelling assumptions or independent and identically distributed data are needed. We elaborate on conditions that render the proposed p-value computable and provide rejection sampling and MCMC algorithms to find a Monte Carlo approximation. Moreover, this article shows how to estimate and construct confidence intervals for a homogeneous treatment effect. Lastly, we demonstrate our method and compare it with other randomization tests using synthetic and real-world data.
Förderung
- GlaxoSmithKline Research & Development Limited
- Engineering and Physical Sciences Research Council
Zitieren
APA
Freidling, T., Zhao, Q., & Gao, Z. (2026). Selective randomization inference for adaptive experiments. Journal of the Royal Statistical Society Series B: Statistical Methodology. https://doi.org/10.1093/jrsssb/qkag081
Vancouver
Freidling T, Zhao Q, Gao Z. Selective randomization inference for adaptive experiments. Journal of the Royal Statistical Society Series B: Statistical Methodology. 2026. doi:10.1093/jrsssb/qkag081
BibTeX
@article{Freidling2026,
author = {Freidling, Tobias and Zhao, Qingyuan and Gao, Zijun},
title = {Selective randomization inference for adaptive experiments},
journal = {Journal of the Royal Statistical Society Series B: Statistical Methodology},
year = {2026},
doi = {10.1093/jrsssb/qkag081}
}
EUVIMED