EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Metacognitive sensitivity: The key to calibrating trust and optimal decision making with AI

Doyeon Lee iD, Joseph Pruitt, Tianyu Zhou iD, Jing Du, Brian Odegaard iD

PNAS Nexus · 30.04.2025 · 4 (5)

DOI: 10.1093/pnasnexus/pgaf133 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 24.04.2025. Verfasst von Doyeon Lee und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Florida, 945 Center Dr., P.O. Box 112250, Gainesville, FL 32611, USA. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 115 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Office of Naval Research, Air Force Office of Scientific Research.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Knowing when to trust and incorporate the advice from artificially intelligent (AI) systems is of increasing importance in the modern world. Research indicates that when AI provides high confidence ratings, human users often correspondingly increase their trust in such judgments, but these increases in trust can occur even when AI fails to provide accurate information on a given task. In this piece, we argue that measures of metacognitive sensitivity provided by AI systems will likely play a critical role in (1) helping individuals to calibrate their level of trust in these systems and (2) optimally incorporating advice from AI into human-AI hybrid decision making. We draw upon a seminal finding in the perceptual decision-making literature that demonstrates the importance of metacognitive ratings for optimal joint decisions and outline a framework to test how different types of information provided by AI systems can guide decision making.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligencejoint decision makingmetacognitive sensitivityoptimal decisionstrust calibration

Autor:innen und Institutionen

  • Department of Psychology, University of Florida, 945 Center Dr., P.O. Box 112250, Gainesville, FL 32611, USA.
  • Department of Civil and Coastal Engineering, University of Florida, Weil Hall 360, 1949 Stadium Road, Gainesville, FL 32611, USA.

ORCID-Profile: Doyeon Lee, Tianyu Zhou, Brian Odegaard

Förderung

  • Office of Naval Research
  • Air Force Office of Scientific Research

Zitieren

APA

Lee, D., Pruitt, J., Zhou, T., Du, J., & Odegaard, B. (2025). Metacognitive sensitivity: The key to calibrating trust and optimal decision making with AI. PNAS Nexus, 4(5). https://doi.org/10.1093/pnasnexus/pgaf133

Vancouver

Lee D, Pruitt J, Zhou T, Du J, Odegaard B. Metacognitive sensitivity: The key to calibrating trust and optimal decision making with AI. PNAS Nexus. 2025;4(5). doi:10.1093/pnasnexus/pgaf133

BibTeX
@article{Lee2025,
  author = {Lee, Doyeon and Pruitt, Joseph and Zhou, Tianyu and Du, Jing and Odegaard, Brian},
  title = {Metacognitive sensitivity: The key to calibrating trust and optimal decision making with AI},
  journal = {PNAS Nexus},
  year = {2025},
  volume = {4},
  number = {5},
  doi = {10.1093/pnasnexus/pgaf133}
}
Kostenlos starten →