Testing for outliers with conformal p-values
The Annals of Statistics · 01.02.2023 · 51 (1) · 149-178
DOI: 10.1214/22-aos2244 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Annals of Statistics, erschienen am 01.02.2023. Verfasst von Stephen Bates und 4 weiteren Autor:innen. Die Arbeit wurde bisher 101-mal zitiert (Crossref) und nennt 103 Literaturangaben.
Abstract (Originalsprache)
This paper studies the construction of p-values for nonparametric outlier detection, from a multiple-testing perspective. The goal is to test whether new independent samples belong to the same distribution as a reference data set or are outliers. We propose a solution based on conformal inference, a general framework yielding p-values that are marginally valid but mutually dependent for different test points. We prove these p-values are positively dependent and enable exact false discovery rate control, although in a relatively weak marginal sense. We then introduce a new method to compute p-values that are valid conditionally on the training data and independent of each other for different test points; this paves the way to stronger type-I error guarantees. Our results depart from classical conformal inference as we leverage concentration inequalities rather than combinatorial arguments to establish our finite-sample guarantees. Further, our techniques also yield a uniform confidence bound for the false positive rate of any outlier detection algorithm, as a function of the threshold applied to its raw statistics. Finally, the relevance of our results is demonstrated by experiments on real and simulated data.
Zitieren
APA
Bates, S., Candès, E., Lei, L., Romano, Y., & Sesia, M. (2023). Testing for outliers with conformal p-values. The Annals of Statistics, 51(1), 149-178. https://doi.org/10.1214/22-aos2244
Vancouver
Bates S, Candès E, Lei L, Romano Y, Sesia M. Testing for outliers with conformal p-values. The Annals of Statistics. 2023;51(1):149-178. doi:10.1214/22-aos2244
BibTeX
@article{Bates2023,
author = {Bates, Stephen and Candès, Emmanuel and Lei, Lihua and Romano, Yaniv and Sesia, Matteo},
title = {Testing for outliers with conformal p-values},
journal = {The Annals of Statistics},
year = {2023},
volume = {51},
number = {1},
pages = {149--178},
doi = {10.1214/22-aos2244}
}
EUVIMED