EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Fairness Theatre: Evaluating Post-Hoc Fairness Interventions in Vendor-Controlled Early Warning Systems

Kelly McConvey, Angelina Zhai, Rebecca Li, Shion Guha

Proceedings of the ACM on Human-Computer Interaction · 30.04.2027 · 11 (2) · 1-37

DOI: 10.1145/3858355 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 18.11.2026. Verfasst von Kelly McConvey und 3 weiteren Autor:innen. Die Arbeit nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Natural Sciences and Engineering Research Council of Canada.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Public institutions increasingly procure AI systems whose design they cannot inspect or change. In higher education, proprietary Early Warning Systems (EWS) leave colleges with few options beyond adjusting model outputs to address inequity. This raises a CSCW question: how is fairness work coordinated among vendors, institutions, advisors, and students with unequal power to change these systems? Using student records from a public college in Ontario, Canada, we evaluate six post-hoc fairness interventions on a research EWS under simulated procurement constraints. We compare fairness, accuracy, and demographic disparities, introducing error-type profiling to trace how interventions redistribute false positives and false negatives. Interventions redistributed disparities without consistently reducing them. Two implementations favoured already-advantaged groups because they used group size to define disadvantage; small, marginalized groups remained poorly served. These findings show how procurement constraints and implementation choices shape the possibilities for fairness work. We call the resulting condition fairness theatre : dashboard metrics converge while groups’ error burdens persist or worsen.

Förderung

  • Natural Sciences and Engineering Research Council of Canada

Zitieren

APA

McConvey, K., Zhai, A., Li, R., & Guha, S. (2027). Fairness Theatre: Evaluating Post-Hoc Fairness Interventions in Vendor-Controlled Early Warning Systems. Proceedings of the ACM on Human-Computer Interaction, 11(2), 1-37. https://doi.org/10.1145/3858355

Vancouver

McConvey K, Zhai A, Li R, Guha S. Fairness Theatre: Evaluating Post-Hoc Fairness Interventions in Vendor-Controlled Early Warning Systems. Proceedings of the ACM on Human-Computer Interaction. 2027;11(2):1-37. doi:10.1145/3858355

BibTeX
@article{McConvey2027,
  author = {McConvey, Kelly and Zhai, Angelina and Li, Rebecca and Guha, Shion},
  title = {Fairness Theatre: Evaluating Post-Hoc Fairness Interventions in Vendor-Controlled Early Warning Systems},
  journal = {Proceedings of the ACM on Human-Computer Interaction},
  year = {2027},
  volume = {11},
  number = {2},
  pages = {1--37},
  doi = {10.1145/3858355}
}
Kostenlos starten →