EUVIMEDEUVIMED entdecken
Crossref

Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies

Kevin Bauer, Andrej Gill

Information Systems Research · 2024-03 · 35 (1) · 226-248

DOI: 10.1287/isre.2023.1217 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information Systems Research, 2024-03. Verfasst von Kevin Bauer und 1 weiteren Autor:innen. Die Arbeit wurde bisher 62-mal zitiert (Crossref) und nennt 107 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Predictive algorithmic scores can significantly impact the lives of assessed individuals by shaping decisions of organizations and institutions that affect them, for example, influencing the hiring prospects of job applicants or the release of defendants on bail. To better protect people and provide them the opportunity to appeal their algorithmic assessments, data privacy advocates and regulators increasingly push for disclosing the scores and their use in decision-making processes to scored individuals. Although inherently important, the response of scored individuals to such algorithmic transparency is understudied. Inspired by psychological and economic theories of information processing, we aim to fill this gap. We conducted a comprehensive empirical study to explore how and why disclosing the use of algorithmic scoring processes to (involuntarily) scored individuals affects their behaviors. Our results provide strong evidence that the disclosure of fundamentally erroneous algorithmic scores evokes self-fulfilling prophecies that endogenously steer the behavior of scored individuals toward their assessment, enabling algorithms to help produce the world they predict. Our results emphasize that isolated transparency measures can have considerable side effects with noticeable implications for the development of automation bias, the occurrence of feedback loops, and the design of transparency regulations.

Zitieren

APA

Bauer, K., & Gill, A. (2024). Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies. Information Systems Research, 35(1), 226-248. https://doi.org/10.1287/isre.2023.1217

Vancouver

Bauer K, Gill A. Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies. Information Systems Research. 2024;35(1):226-248. doi:10.1287/isre.2023.1217

BibTeX
@article{Bauer2024,
  author = {Bauer, Kevin and Gill, Andrej},
  title = {Mirror, Mirror on the Wall: Algorithmic Assessments, Transparency, and Self-Fulfilling Prophecies},
  journal = {Information Systems Research},
  year = {2024},
  volume = {35},
  number = {1},
  pages = {226--248},
  doi = {10.1287/isre.2023.1217}
}
Kostenlos starten →