EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Effect of Explanation Conceptualisations on Trust in AI-assisted Credibility Assessment

Saumya Pareek, Niels van Berkel, Eduardo Velloso, Jorge Goncalves

Proceedings of the ACM on Human-Computer Interaction · 07.11.2024 · 8 (CSCW2) · 1-31

DOI: 10.1145/3686922 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 08.11.2024. Verfasst von Saumya Pareek und 3 weiteren Autor:innen. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 124 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As misinformation increasingly proliferates on social media platforms, it has become crucial to explore how to best convey automated news credibility assessments to end-users, and foster trust in fact-checking AIs. In this paper, we investigate how model-agnostic, natural language explanations influence trust and reliance on a fact-checking AI. We construct explanations from four Conceptualisation Validations (CVs) - namely consensual, expert, internal (logical), and empirical - which are foundational units of evidence that humans utilise to validate and accept new information. Our results show that providing explanations significantly enhances trust in AI, even in a fact-checking context where influencing pre-existing beliefs is often challenging, with different CVs causing varying degrees of reliance. We find consensual explanations to be the least influential, with expert, internal, and empirical explanations exerting twice as much influence. However, we also find that users could not discern whether the AI directed them towards the truth, highlighting the dual nature of explanations to both guide and potentially mislead. Further, we uncover the presence of automation bias and aversion during collaborative fact-checking, indicating how users' previously established trust in AI can moderate their reliance on AI judgements. We also observe the manifestation of a 'boomerang'/backfire effect often seen in traditional corrections to misinformation, with individuals who perceive AI as biased or untrustworthy doubling down and reinforcing their existing (in)correct beliefs when challenged by the AI. We conclude by presenting nuanced insights into the dynamics of user behaviour during AI-based fact-checking, offering important lessons for social media platforms.

Zitieren

APA

Pareek, S., Berkel, N. V., Velloso, E., & Goncalves, J. (2024). Effect of Explanation Conceptualisations on Trust in AI-assisted Credibility Assessment. Proceedings of the ACM on Human-Computer Interaction, 8(CSCW2), 1-31. https://doi.org/10.1145/3686922

Vancouver

Pareek S, Berkel NV, Velloso E, Goncalves J. Effect of Explanation Conceptualisations on Trust in AI-assisted Credibility Assessment. Proceedings of the ACM on Human-Computer Interaction. 2024;8(CSCW2):1-31. doi:10.1145/3686922

BibTeX
@article{Pareek2024,
  author = {Pareek, Saumya and Berkel, Niels van and Velloso, Eduardo and Goncalves, Jorge},
  title = {Effect of Explanation Conceptualisations on Trust in AI-assisted Credibility Assessment},
  journal = {Proceedings of the ACM on Human-Computer Interaction},
  year = {2024},
  volume = {8},
  number = {CSCW2},
  pages = {1--31},
  doi = {10.1145/3686922}
}
Kostenlos starten →