EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making

Shiye Cao, Anqi Liu, Chien-Ming Huang

Proceedings of the ACM on Human-Computer Interaction · 17.04.2024 · 8 (CSCW1) · 1-32

DOI: 10.1145/3637318 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 26.04.2024. Verfasst von Shiye Cao und 2 weiteren Autor:innen. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 107 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Appropriate reliance is critical to achieving synergistic human-AI collaboration. For instance, when users over-rely on AI assistance, their human-AI team performance is bounded by the model's capability. This work studies how the presentation of model uncertainty may steer users' decision-making toward fostering appropriate reliance. Our results demonstrate that showing the calibrated model uncertainty alone is inadequate. Rather, calibrating model uncertainty and presenting it in a frequency format allow users to adjust their reliance accordingly and help reduce the effect of confirmation bias on their decisions. Furthermore, the critical nature of our skin cancer screening task skews participants' judgment, causing their reliance to vary depending on their initial decision. Additionally, step-wise multiple regression analyses revealed how user demographics such as age and familiarity with probability and statistics influence human-AI collaborative decision-making. We discuss the potential for model uncertainty presentation, initial user decision, and user demographics to be incorporated in designing personalized AI aids for appropriate reliance.

Förderung

  • National Science Foundation

Zitieren

APA

Cao, S., Liu, A., & Huang, C. (2024). Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making. Proceedings of the ACM on Human-Computer Interaction, 8(CSCW1), 1-32. https://doi.org/10.1145/3637318

Vancouver

Cao S, Liu A, Huang C. Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making. Proceedings of the ACM on Human-Computer Interaction. 2024;8(CSCW1):1-32. doi:10.1145/3637318

BibTeX
@article{Cao2024,
  author = {Cao, Shiye and Liu, Anqi and Huang, Chien-Ming},
  title = {Designing for Appropriate Reliance: The Roles of AI Uncertainty Presentation, Initial User Decision, and User Demographics in AI-Assisted Decision-Making},
  journal = {Proceedings of the ACM on Human-Computer Interaction},
  year = {2024},
  volume = {8},
  number = {CSCW1},
  pages = {1--32},
  doi = {10.1145/3637318}
}
Kostenlos starten →