Against Predictive Optimization: On the Legitimacy of Decision-making Algorithms That Optimize Predictive Accuracy
ACM Journal on Responsible Computing · 31.03.2024 · 1 (1) · 1-45
DOI: 10.1145/3636509 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Journal on Responsible Computing, online erschienen am 20.03.2024. Verfasst von Angelina Wang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 54-mal zitiert (Crossref) und nennt 226 Literaturangaben. Gefördert von: National Science Foundation, Graduate Research Fellowship to A.W..
Abstract (Originalsprache)
We formalize predictive optimization, a category of decision-making algorithms that use machine learning (ML) to predict future outcomes of interest about individuals . For example, pre-trial risk prediction algorithms such as COMPAS use ML to predict whether an individual will re-offend in the future. Our thesis is that predictive optimization raises a distinctive and serious set of normative concerns that cause it to fail on its own terms. To test this, we review 387 reports, articles, and web pages from academia, industry, non-profits, governments, and data science contests, and we find many real-world examples of predictive optimization. We select eight particularly consequential examples as case studies. Simultaneously, we develop a set of normative and technical critiques that challenge the claims made by the developers of these applications—in particular, claims of increased accuracy, efficiency, and fairness. Our key finding is that these critiques apply to each of the applications, are not easily evaded by redesigning the systems, and thus challenge whether these applications should be deployed. We argue that the burden of evidence for justifying why the deployment of predictive optimization is not harmful should rest with the developers of the tools. Based on our analysis, we provide a rubric of critical questions that can be used to deliberate or contest specific predictive optimization applications. 1
Förderung
- National Science Foundation
- Graduate Research Fellowship to A.W.
Zitieren
APA
Wang, A., Kapoor, S., Barocas, S., & Narayanan, A. (2024). Against Predictive Optimization: On the Legitimacy of Decision-making Algorithms That Optimize Predictive Accuracy. ACM Journal on Responsible Computing, 1(1), 1-45. https://doi.org/10.1145/3636509
Vancouver
Wang A, Kapoor S, Barocas S, Narayanan A. Against Predictive Optimization: On the Legitimacy of Decision-making Algorithms That Optimize Predictive Accuracy. ACM Journal on Responsible Computing. 2024;1(1):1-45. doi:10.1145/3636509
BibTeX
@article{Wang2024,
author = {Wang, Angelina and Kapoor, Sayash and Barocas, Solon and Narayanan, Arvind},
title = {Against Predictive Optimization: On the Legitimacy of Decision-making Algorithms That Optimize Predictive Accuracy},
journal = {ACM Journal on Responsible Computing},
year = {2024},
volume = {1},
number = {1},
pages = {1--45},
doi = {10.1145/3636509}
}
EUVIMED