Measuring Trust Dynamics in AI-Assisted Decision-Making: Insights from an Experimental Study
Journal of the Association for Information Systems · 01.01.2025
DOI: 10.24451/arbor.12730 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the Association for Information Systems, erschienen am 01.01.2025. Verfasst von Léane Wettstein und 3 weiteren Autor:innen.
Abstract (Originalsprache)
Trust calibration is a central component for adopting new information systems (IS) technologies, especially for AI-assisted decision-making systems. While trust is defined as an attitude with dynamic processes that evolve throughout the interaction, current research lacks a comprehensive understanding of how to measure these dynamic changes. This study seeks to evaluate the sensitivity of three common trust measurement methods-single-item scales, questionnaires, and trust games-to capture changes in trust over time. In an online experiment, participants (N = 228) interacted with a simulated AI-system for stock-market investments. The results suggest that only questionnaires are sensitive to trust changes and enable the measurement of dynamic trust, while trust games allow the measurement of dynamic reliance processes. This study contributes to developing more sensitive methods to better understand the calibration of trust and reliance in Human-AI collaboration, with broader implications for the design and evaluation of IS.
Schlagwörter
Zitieren
APA
Wettstein, L., Wambsganß, T., Rietsche, R., & Scharowski, N. (2025). Measuring Trust Dynamics in AI-Assisted Decision-Making: Insights from an Experimental Study. Journal of the Association for Information Systems. https://doi.org/10.24451/arbor.12730
Vancouver
Wettstein L, Wambsganß T, Rietsche R, Scharowski N. Measuring Trust Dynamics in AI-Assisted Decision-Making: Insights from an Experimental Study. Journal of the Association for Information Systems. 2025. doi:10.24451/arbor.12730
BibTeX
@article{Wettstein2025,
author = {Wettstein, Léane and Wambsganß, Thiemo and Rietsche, Roman and Scharowski, Nicolas},
title = {Measuring Trust Dynamics in AI-Assisted Decision-Making: Insights from an Experimental Study},
journal = {Journal of the Association for Information Systems},
year = {2025},
doi = {10.24451/arbor.12730}
}
EUVIMED