Improving Human-AI Collaboration With Descriptions of AI Behavior
Proceedings of the ACM on Human-Computer Interaction · 14.04.2023 · 7 (CSCW1) · 1-21
DOI: 10.1145/3579612 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 16.04.2023. Verfasst von Ángel Alexander Cabrera und 2 weiteren Autor:innen. Die Arbeit wurde bisher 90-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.
Abstract (Originalsprache)
People work with AI systems to improve their decision making, but often under- or over-rely on AI predictions and perform worse than they would have unassisted. To help people appropriately rely on AI aids, we propose showing them behavior descriptions, details of how AI systems perform on subgroups of instances. We tested the efficacy of behavior descriptions through user studies with 225 participants in three distinct domains: fake review detection, satellite image classification, and bird classification. We found that behavior descriptions can increase human-AI accuracy through two mechanisms: helping people identify AI failures and increasing people's reliance on the AI when it is more accurate. These findings highlight the importance of people's mental models in human-AI collaboration and show that informing people of high-level AI behaviors can significantly improve AI-assisted decision making.
Förderung
- National Science Foundation
Zitieren
APA
Cabrera, Á. A., Perer, A., & Hong, J. I. (2023). Improving Human-AI Collaboration With Descriptions of AI Behavior. Proceedings of the ACM on Human-Computer Interaction, 7(CSCW1), 1-21. https://doi.org/10.1145/3579612
Vancouver
Cabrera ÁA, Perer A, Hong JI. Improving Human-AI Collaboration With Descriptions of AI Behavior. Proceedings of the ACM on Human-Computer Interaction. 2023;7(CSCW1):1-21. doi:10.1145/3579612
BibTeX
@article{Cabrera2023,
author = {Cabrera, Ángel Alexander and Perer, Adam and Hong, Jason I.},
title = {Improving Human-AI Collaboration With Descriptions of AI Behavior},
journal = {Proceedings of the ACM on Human-Computer Interaction},
year = {2023},
volume = {7},
number = {CSCW1},
pages = {1--21},
doi = {10.1145/3579612}
}
EUVIMED