Improving the Sensitivity of Controlled Experiments by Stratified Empirical Likelihood Ratio Tests
Journal of Survey Statistics and Methodology · 01.07.2026
DOI: 10.1093/jssam/smag020 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Survey Statistics and Methodology, online erschienen am 01.07.2026. Verfasst von Yongda Wang und 3 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This article addresses the challenge of low statistical power in A/B testing with small sample data, such as Automatic Speech Recognition data. Traditional methods, such as the Welch t-test, often underperform in these scenarios. We introduce two novel testing methods, the stratified and post-stratified empirical likelihood ratio tests, which reduce group variance and enhance test sensitivity. Our theoretical analysis and comprehensive experiments on real and synthetic datasets show that these nonparametric empirical likelihood ratio methods outperform the Welch t-test with small-sample data, providing a more effective tool for detecting treatment effects and informing data-driven decision-making.
Zitieren
APA
Wang, Y., Chen, D., Wang, C. K., & Xiong, S. (2026). Improving the Sensitivity of Controlled Experiments by Stratified Empirical Likelihood Ratio Tests. Journal of Survey Statistics and Methodology. https://doi.org/10.1093/jssam/smag020
Vancouver
Wang Y, Chen D, Wang CK, Xiong S. Improving the Sensitivity of Controlled Experiments by Stratified Empirical Likelihood Ratio Tests. Journal of Survey Statistics and Methodology. 2026. doi:10.1093/jssam/smag020
BibTeX
@article{Wang2026,
author = {Wang, Yongda and Chen, Daijun and Wang, Chun Kai and Xiong, Shifeng},
title = {Improving the Sensitivity of Controlled Experiments by Stratified Empirical Likelihood Ratio Tests},
journal = {Journal of Survey Statistics and Methodology},
year = {2026},
doi = {10.1093/jssam/smag020}
}
EUVIMED