Conformal prediction beyond exchangeability
The Annals of Statistics · 01.04.2023 · 51 (2) · 816-845
DOI: 10.1214/23-aos2276 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Annals of Statistics, erschienen am 01.04.2023. Verfasst von Rina Foygel Barber und 3 weiteren Autor:innen. Die Arbeit wurde bisher 401-mal zitiert (Crossref) und nennt 35 Literaturangaben.
Abstract (Originalsprache)
Conformal prediction is a popular, modern technique for providing valid predictive inference for arbitrary machine learning models. Its validity relies on the assumptions of exchangeability of the data, and symmetry of the given model fitting algorithm as a function of the data. However, exchangeability is often violated when predictive models are deployed in practice. For example, if the data distribution drifts over time, then the data points are no longer exchangeable; moreover, in such settings, we might want to use a nonsymmetric algorithm that treats recent observations as more relevant. This paper generalizes conformal prediction to deal with both aspects: we employ weighted quantiles to introduce robustness against distribution drift, and design a new randomization technique to allow for algorithms that do not treat data points symmetrically. Our new methods are provably robust, with substantially less loss of coverage when exchangeability is violated due to distribution drift or other challenging features of real data, while also achieving the same coverage guarantees as existing conformal prediction methods if the data points are in fact exchangeable. We demonstrate the practical utility of these new tools with simulations and real-data experiments on electricity and election forecasting.
Zitieren
APA
Barber, R. F., Candès, E. J., Ramdas, A., & Tibshirani, R. J. (2023). Conformal prediction beyond exchangeability. The Annals of Statistics, 51(2), 816-845. https://doi.org/10.1214/23-aos2276
Vancouver
Barber RF, Candès EJ, Ramdas A, Tibshirani RJ. Conformal prediction beyond exchangeability. The Annals of Statistics. 2023;51(2):816-845. doi:10.1214/23-aos2276
BibTeX
@article{Barber2023,
author = {Barber, Rina Foygel and Candès, Emmanuel J. and Ramdas, Aaditya and Tibshirani, Ryan J.},
title = {Conformal prediction beyond exchangeability},
journal = {The Annals of Statistics},
year = {2023},
volume = {51},
number = {2},
pages = {816--845},
doi = {10.1214/23-aos2276}
}
EUVIMED