Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making
Proceedings of the ACM on Human-Computer Interaction · 17.04.2024 · 8 (CSCW1) · 1-32
DOI: 10.1145/3637318 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 26.04.2024. Verfasst von Shiye Cao und 2 weiteren Autor:innen. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 107 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.
Abstract (Originalsprache)
Appropriate reliance is critical to achieving synergistic human-AI collaboration. For instance, when users over-rely on AI assistance, their human-AI team performance is bounded by the model's capability. This work studies how the presentation of model uncertainty may steer users' decision-making toward fostering appropriate reliance. Our results demonstrate that showing the calibrated model uncertainty alone is inadequate. Rather, calibrating model uncertainty and presenting it in a frequency format allow users to adjust their reliance accordingly and help reduce the effect of confirmation bias on their decisions. Furthermore, the critical nature of our skin cancer screening task skews participants' judgment, causing their reliance to vary depending on their initial decision. Additionally, step-wise multiple regression analyses revealed how user demographics such as age and familiarity with probability and statistics influence human-AI collaborative decision-making. We discuss the potential for model uncertainty presentation, initial user decision, and user demographics to be incorporated in designing personalized AI aids for appropriate reliance.
Förderung
- National Science Foundation
Zitieren
APA
Cao, S., Liu, A., & Huang, C. (2024). Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making. Proceedings of the ACM on Human-Computer Interaction, 8(CSCW1), 1-32. https://doi.org/10.1145/3637318
Vancouver
Cao S, Liu A, Huang C. Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making. Proceedings of the ACM on Human-Computer Interaction. 2024;8(CSCW1):1-32. doi:10.1145/3637318
BibTeX
@article{Cao2024,
author = {Cao, Shiye and Liu, Anqi and Huang, Chien-Ming},
title = {Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making},
journal = {Proceedings of the ACM on Human-Computer Interaction},
year = {2024},
volume = {8},
number = {CSCW1},
pages = {1--32},
doi = {10.1145/3637318}
}
EUVIMED