Unintended machine learning biases as social barriers for persons with disabilitiess
ACM SIGACCESS Accessibility and Computing · 02.03.2020 · (125) · 1-1
DOI: 10.1145/3386296.3386305 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM SIGACCESS Accessibility and Computing, online erschienen am 02.03.2020. Verfasst von Ben Hutchinson und 5 weiteren Autor:innen. Die Arbeit wurde bisher 37-mal zitiert (Crossref) und nennt 30 Literaturangaben.
Abstract (Originalsprache)
Persons with disabilities face many barriers to full participation in society, and the rapid advancement of technology has the potential to create ever more. Building equitable and inclusive technologies for people with disabilities demands paying attention to more than accessibility, but also to how social attitudes towards disability are represented within technology. Representations perpetuated by machine learning (ML) models often inadvertently encode undesirable social biases from the data on which they are trained. This can result, for example, in text classification models producing very different predictions for I am a person with mental illness , and I am a tall person . In this paper, we present evidence of such biases in existing ML models, and in data used for model development. First, we demonstrate that a machine-learned model to moderate conversations classifies texts which mention disability as more "toxic". Similarly, a machine-learned sentiment analysis model rates texts which mention disability as more negative. Second, we demonstrate that neural text representation models that are critical to many ML applications can also contain undesirable biases towards mentions of disabilities. Third, we show that the data used to develop such models reflects topical biases in social discourse which may explain such biases in the models - for instance, gun violence, homelessness, and drug addiction are over-represented in discussions about mental illness.
Zitieren
APA
Hutchinson, B., Prabhakaran, V., Denton, R., Webster, K., Zhong, Y., & Denuyl, S. (2020). Unintended machine learning biases as social barriers for persons with disabilitiess. ACM SIGACCESS Accessibility and Computing, 1-1. https://doi.org/10.1145/3386296.3386305
Vancouver
Hutchinson B, Prabhakaran V, Denton R, Webster K, Zhong Y, Denuyl S. Unintended machine learning biases as social barriers for persons with disabilitiess. ACM SIGACCESS Accessibility and Computing. 2020:1-1. doi:10.1145/3386296.3386305
BibTeX
@article{Hutchinson2020,
author = {Hutchinson, Ben and Prabhakaran, Vinodkumar and Denton, Remi and Webster, Kellie and Zhong, Yu and Denuyl, Stephen},
title = {Unintended machine learning biases as social barriers for persons with disabilitiess},
journal = {ACM SIGACCESS Accessibility and Computing},
year = {2020},
number = {125},
pages = {1--1},
doi = {10.1145/3386296.3386305}
}
EUVIMED