EUVIMEDEUVIMED entdecken
Crossref

Calibration through the Lens of Indistinguishability

Parikshit Gopalan, Lunjia Hu

ACM SIGecom Exchanges · 01.07.2025 · 23 (1) · 51-79

DOI: 10.1145/3821553.3821560 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM SIGecom Exchanges, online erschienen am 01.07.2026. Verfasst von Parikshit Gopalan und 1 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Calibration is a classical notion from the forecasting literature which aims to address the question: how should predicted probabilities be interpreted? In a world where we only get to observe (discrete) outcomes, how should we evaluate a predictor that hypothesizes (continuous) probabilities over possible outcomes? The study of calibration has seen a surge of recent interest, given the ubiquity of probabilistic predictions in machine learning. This survey describes recent work on the foundational questions of how to define and measure calibration error, and what these measures mean for downstream decision makers who wish to use the predictions to make decisions. A unifying viewpoint that emerges is that of calibration as a form of indistinguishability, between the world hypothesized by the predictor and the real world (governed by nature or the Bayes optimal predictor). In this view, various calibration measures quantify the extent to which the two worlds can be told apart by certain classes of distinguishers or statistical measures.

Zitieren

APA

Gopalan, P., & Hu, L. (2025). Calibration through the Lens of Indistinguishability. ACM SIGecom Exchanges, 23(1), 51-79. https://doi.org/10.1145/3821553.3821560

Vancouver

Gopalan P, Hu L. Calibration through the Lens of Indistinguishability. ACM SIGecom Exchanges. 2025;23(1):51-79. doi:10.1145/3821553.3821560

BibTeX
@article{Gopalan2025,
  author = {Gopalan, Parikshit and Hu, Lunjia},
  title = {Calibration through the Lens of Indistinguishability},
  journal = {ACM SIGecom Exchanges},
  year = {2025},
  volume = {23},
  number = {1},
  pages = {51--79},
  doi = {10.1145/3821553.3821560}
}
Kostenlos starten →