Metacognitive sensitivity: The key to calibrating trust and optimal decision making with AI
PNAS Nexus · 30.04.2025 · 4 (5)
DOI: 10.1093/pnasnexus/pgaf133 ↗Kurz gefasst
Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 24.04.2025. Verfasst von Doyeon Lee und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Florida, 945 Center Dr., P.O. Box 112250, Gainesville, FL 32611, USA. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 115 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Office of Naval Research, Air Force Office of Scientific Research.
Abstract (Originalsprache)
Knowing when to trust and incorporate the advice from artificially intelligent (AI) systems is of increasing importance in the modern world. Research indicates that when AI provides high confidence ratings, human users often correspondingly increase their trust in such judgments, but these increases in trust can occur even when AI fails to provide accurate information on a given task. In this piece, we argue that measures of metacognitive sensitivity provided by AI systems will likely play a critical role in (1) helping individuals to calibrate their level of trust in these systems and (2) optimally incorporating advice from AI into human-AI hybrid decision making. We draw upon a seminal finding in the perceptual decision-making literature that demonstrates the importance of metacognitive ratings for optimal joint decisions and outline a framework to test how different types of information provided by AI systems can guide decision making.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychology, University of Florida, 945 Center Dr., P.O. Box 112250, Gainesville, FL 32611, USA.
- Department of Civil and Coastal Engineering, University of Florida, Weil Hall 360, 1949 Stadium Road, Gainesville, FL 32611, USA.
ORCID-Profile: Doyeon Lee, Tianyu Zhou, Brian Odegaard
Förderung
- Office of Naval Research
- Air Force Office of Scientific Research
Zitieren
APA
Lee, D., Pruitt, J., Zhou, T., Du, J., & Odegaard, B. (2025). Metacognitive sensitivity: The key to calibrating trust and optimal decision making with AI. PNAS Nexus, 4(5). https://doi.org/10.1093/pnasnexus/pgaf133
Vancouver
Lee D, Pruitt J, Zhou T, Du J, Odegaard B. Metacognitive sensitivity: The key to calibrating trust and optimal decision making with AI. PNAS Nexus. 2025;4(5). doi:10.1093/pnasnexus/pgaf133
BibTeX
@article{Lee2025,
author = {Lee, Doyeon and Pruitt, Joseph and Zhou, Tianyu and Du, Jing and Odegaard, Brian},
title = {Metacognitive sensitivity: The key to calibrating trust and optimal decision making with AI},
journal = {PNAS Nexus},
year = {2025},
volume = {4},
number = {5},
doi = {10.1093/pnasnexus/pgaf133}
}
EUVIMED