EUVIMEDEUVIMED entdecken
Crossref

Robust Design and Evaluation of Predictive Algorithms under Unobserved Confounding

Ashesh Rambachan, Amanda Coston, Edward H. Kennedy

Review of Economics and Statistics · 18.06.2026 · 1-40

DOI: 10.1162/rest.a.1815 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Review of Economics and Statistics, online erschienen am 18.06.2026. Verfasst von Ashesh Rambachan und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Predictive algorithms inform consequential decisions in settings with selective labels: outcomes are observed only for units selected by past decision makers. This creates an identification problem under unobserved confounding — when selected and unselected units differ in unobserved ways that affect outcomes. We propose a framework for robust design and evaluation of predictive algorithms that bounds how much outcomes may differ between selected and unselected units with the same observed characteristics. These bounds formalize common empirical strategies including proxy outcomes and instrumental variables. Our estimators work across bounding strategies and performance measures such as conditional likelihoods, mean squared error, and true/false positive rates. Using administrative data from a large Australian financial institution, we show that varying confounding assumptions substantially affects credit risk predictions and fairness evaluations across income groups.

Zitieren

APA

Rambachan, A., Coston, A., & Kennedy, E. H. (2026). Robust Design and Evaluation of Predictive Algorithms under Unobserved Confounding. Review of Economics and Statistics, 1-40. https://doi.org/10.1162/rest.a.1815

Vancouver

Rambachan A, Coston A, Kennedy EH. Robust Design and Evaluation of Predictive Algorithms under Unobserved Confounding. Review of Economics and Statistics. 2026:1-40. doi:10.1162/rest.a.1815

BibTeX
@article{Rambachan2026,
  author = {Rambachan, Ashesh and Coston, Amanda and Kennedy, Edward H.},
  title = {Robust Design and Evaluation of Predictive Algorithms under Unobserved Confounding},
  journal = {Review of Economics and Statistics},
  year = {2026},
  pages = {1--40},
  doi = {10.1162/rest.a.1815}
}
Kostenlos starten →