EUVIMEDEUVIMED entdecken
Crossref

Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classification

A. Feder Cooper, Katherine Lee, Madiha Zahrah Choksi, Solon Barocas, Christopher De Sa, James Grimmelmann, Jon Kleinberg, Siddhartha Sen, Baobao Zhang

Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (20) · 22004-22012

DOI: 10.1609/aaai.v38i20.30203 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von A. Feder Cooper und 8 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Variance in predictions across different trained models is a significant, under-explored source of error in fair binary classification. In practice, the variance on some data examples is so large that decisions can be effectively arbitrary. To investigate this problem, we take an experimental approach and make four overarching contributions. We: 1) Define a metric called self-consistency, derived from variance, which we use as a proxy for measuring and reducing arbitrariness; 2) Develop an ensembling algorithm that abstains from classification when a prediction would be arbitrary; 3) Conduct the largest to-date empirical study of the role of variance (vis-a-vis self-consistency and arbitrariness) in fair binary classification; and, 4) Release a toolkit that makes the US Home Mortgage Disclosure Act (HMDA) datasets easily usable for future research. Altogether, our experiments reveal shocking insights about the reliability of conclusions on benchmark datasets. Most fair binary classification benchmarks are close-to-fair when taking into account the amount of arbitrariness present in predictions -- before we even try to apply any fairness interventions. This finding calls into question the practical utility of common algorithmic fairness methods, and in turn suggests that we should reconsider how we choose to measure fairness in binary classification.

Zitieren

APA

Cooper, A. F., Lee, K., Choksi, M. Z., Barocas, S., Sa, C. D., Grimmelmann, J., Kleinberg, J., Sen, S., & Zhang, B. (2024). Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classification. Proceedings of the AAAI Conference on Artificial Intelligence, 38(20), 22004-22012. https://doi.org/10.1609/aaai.v38i20.30203

Vancouver

Cooper AF, Lee K, Choksi MZ, Barocas S, Sa CD, Grimmelmann J, et al. Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classification. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(20):22004-22012. doi:10.1609/aaai.v38i20.30203

BibTeX
@article{Cooper2024,
  author = {Cooper, A. Feder and Lee, Katherine and Choksi, Madiha Zahrah and Barocas, Solon and Sa, Christopher De and Grimmelmann, James and Kleinberg, Jon and Sen, Siddhartha and Zhang, Baobao},
  title = {Arbitrariness and Social Prediction: The Confounding Role of Variance in Fair Classification},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2024},
  volume = {38},
  number = {20},
  pages = {22004--22012},
  doi = {10.1609/aaai.v38i20.30203}
}
Kostenlos starten →