EUVIMEDEUVIMED entdecken
Crossref

Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance

Gagan Bansal, Besmira Nushi, Ece Kamar, Walter S. Lasecki, Daniel S. Weld, Eric Horvitz

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · 28.10.2019 · 7 · 2-11

DOI: 10.1609/hcomp.v7i1.5285 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, online erschienen am 28.10.2019. Verfasst von Gagan Bansal und 5 weiteren Autor:innen. Die Arbeit wurde bisher 387-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Decisions made by human-AI teams (e.g., AI-advised humans) are increasingly common in high-stakes domains such as healthcare, criminal justice, and finance. Achieving high team performance depends on more than just the accuracy of the AI system: Since the human and the AI may have different expertise, the highest team performance is often reached when they both know how and when to complement one another. We focus on a factor that is crucial to supporting such complementary: the human’s mental model of the AI capabilities, specifically the AI system’s error boundary (i.e. knowing “When does the AI err?”). Awareness of this lets the human decide when to accept or override the AI’s recommendation. We highlight two key properties of an AI’s error boundary, parsimony and stochasticity, and a property of the task, dimensionality. We show experimentally how these properties affect humans’ mental models of AI capabilities and the resulting team performance. We connect our evaluations to related work and propose goals, beyond accuracy, that merit consideration during model selection and optimization to improve overall human-AI team performance.

Zitieren

APA

Bansal, G., Nushi, B., Kamar, E., Lasecki, W. S., Weld, D. S., & Horvitz, E. (2019). Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 7, 2-11. https://doi.org/10.1609/hcomp.v7i1.5285

Vancouver

Bansal G, Nushi B, Kamar E, Lasecki WS, Weld DS, Horvitz E. Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. 2019;7:2-11. doi:10.1609/hcomp.v7i1.5285

BibTeX
@article{Bansal2019,
  author = {Bansal, Gagan and Nushi, Besmira and Kamar, Ece and Lasecki, Walter S. and Weld, Daniel S. and Horvitz, Eric},
  title = {Beyond Accuracy: The Role of Mental Models in Human-AI Team Performance},
  journal = {Proceedings of the AAAI Conference on Human Computation and Crowdsourcing},
  year = {2019},
  volume = {7},
  pages = {2--11},
  doi = {10.1609/hcomp.v7i1.5285}
}
Kostenlos starten →