EUVIMEDEUVIMED entdecken
Crossref

Conformal Prediction: A Gentle Introduction

Anastasios N. Angelopoulos, Stephen Bates

Foundations and Trends® in Machine Learning · 27.03.2023 · 16 (4) · 494-591

DOI: 10.1561/2200000101 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Foundations and Trends® in Machine Learning, online erschienen am 27.03.2023. Verfasst von Anastasios N. Angelopoulos und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1045-mal zitiert (Crossref) und nennt 132 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Black-box machine learning models are now routinely used in high-risk settings, like medical diagnostics, which demand uncertainty quantification to avoid consequential model failures. Conformal prediction (a.k.a. conformal inference) is a user-friendly paradigm for creating statistically rigorous uncertainty sets/intervals for the predictions of such models. Critically, the sets are valid in a distribution-free sense: they possess explicit, non-asymptotic guarantees even without distributional assumptions or model assumptions. One can use conformal prediction with any pre-trained model, such as a neural network, to produce sets that are guaranteed to contain the ground truth with a user-specified probability, such as 90%. It is easy-to-understand, easy-to-use, and general, applying naturally to problems arising in the fields of computer vision, natural language processing, deep reinforcement learning, and so on. This hands-on introduction is aimed to provide the reader a working understanding of conformal prediction and related distribution-free uncertainty quantification techniques with one self-contained document. We lead the reader through practical theory for and examples of conformal prediction and describe its extensions to complex machine learning tasks involving structured outputs, distribution shift, timeseries, outliers, models that abstain, and more. Throughout, there are many explanatory illustrations, examples, and code samples in Python. With each code sample comes a Jupyter notebook implementing the method on a real-data example; the notebooks can be accessed and easily run by following the code footnotes.</>

Zitieren

APA

Angelopoulos, A. N., & Bates, S. (2023). Conformal Prediction: A Gentle Introduction. Foundations and Trends® in Machine Learning, 16(4), 494-591. https://doi.org/10.1561/2200000101

Vancouver

Angelopoulos AN, Bates S. Conformal Prediction: A Gentle Introduction. Foundations and Trends® in Machine Learning. 2023;16(4):494-591. doi:10.1561/2200000101

BibTeX
@article{Angelopoulos2023,
  author = {Angelopoulos, Anastasios N. and Bates, Stephen},
  title = {Conformal Prediction: A Gentle Introduction},
  journal = {Foundations and Trends® in Machine Learning},
  year = {2023},
  volume = {16},
  number = {4},
  pages = {494--591},
  doi = {10.1561/2200000101}
}
Kostenlos starten →