Fairness in Algorithmic Profiling: The AMAS Case
Minds and Machines · 29.01.2025 · 35 (1)
DOI: 10.1007/s11023-024-09706-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Minds and Machines, online erschienen am 29.01.2025. Verfasst von Eva Achterhold und 3 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 71 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ludwig-Maximilians-Universität München.
Abstract (Originalsprache)
We study a controversial application of algorithmic profiling in the public sector, the Austrian AMAS system. AMAS was supposed to help caseworkers at the Public Employment Service (PES) Austria to allocate support measures to job seekers based on their predicted chance of (re-)integration into the labor market. Shortly after its release, AMAS was criticized for its apparent unequal treatment of job seekers based on gender and citizenship. We systematically investigate the AMAS model using a novel real-world dataset of young job seekers from Vienna, which allows us to provide the first empirical evaluation of the AMAS model with a focus on fairness measures. We further apply bias mitigation strategies to study their effectiveness in our real-world setting. Our findings indicate that the prediction performance of the AMAS model is insufficient for use in practice, as more than 30% of job seekers would be misclassified in our use case. Further, our results confirm that the original model is biased with respect to gender as it tends to (incorrectly) assign women to the group with high chances of re-employment, which is not prioritized in the PES’ allocation of support measures. However, most bias mitigation strategies were able to improve fairness without compromising performance and thus may form an important building block in revising profiling schemes in the present context.
Förderung
- Ludwig-Maximilians-Universität München
Zitieren
APA
Achterhold, E., Mühlböck, M., Steiber, N., & Kern, C. (2025). Fairness in Algorithmic Profiling: The AMAS Case. Minds and Machines, 35(1). https://doi.org/10.1007/s11023-024-09706-9
Vancouver
Achterhold E, Mühlböck M, Steiber N, Kern C. Fairness in Algorithmic Profiling: The AMAS Case. Minds and Machines. 2025;35(1). doi:10.1007/s11023-024-09706-9
BibTeX
@article{Achterhold2025,
author = {Achterhold, Eva and Mühlböck, Monika and Steiber, Nadia and Kern, Christoph},
title = {Fairness in Algorithmic Profiling: The AMAS Case},
journal = {Minds and Machines},
year = {2025},
volume = {35},
number = {1},
doi = {10.1007/s11023-024-09706-9}
}
EUVIMED