The Importance of Metacognitive Sensitivity in Human-AI Decision-Making
eScholarship (California Digital Library) · 18.06.2025
DOI: 10.48448/cbk7-z574 ↗Kurz gefasst
Fachartikel in der Zeitschrift eScholarship (California Digital Library), erschienen am 18.06.2025. Verfasst von Cognitive Science Society 2025 und 2 weiteren Autor:innen.
Abstract (Originalsprache)
In human-AI decision-making, understanding the factors that maximize overall accuracy remains a critical challenge. This study highlights the role of metacognitive sensitivity—the agent's ability to assign confidence scores that reliably distinguish between correct and incorrect predictions. We propose a theoretical framework to evaluate the impact of accuracy and metacognitive sensitivity in hybrid decision-making contexts. Our analytical results establish conditions under which an agent with lower accuracy but higher metacognitive sensitivity can enhance overall decision accuracy when paired with another agent. Empirical analyses on a real-world image classification dataset confirm that stronger metacognitive sensitivity—whether in AI or human agents—can improve joint decision outcomes. These findings advocate for a more comprehensive approach to evaluating AI and human collaborators, emphasizing the joint optimization of accuracy and metacognitive sensitivity for enhanced decision-making.
Schlagwörter
Zitieren
APA
2025, C. S. S., Li, Z., & Steyvers, M. (2025). The Importance of Metacognitive Sensitivity in Human-AI Decision-Making. eScholarship (California Digital Library). https://doi.org/10.48448/cbk7-z574
Vancouver
2025 CSS, Li Z, Steyvers M. The Importance of Metacognitive Sensitivity in Human-AI Decision-Making. eScholarship (California Digital Library). 2025. doi:10.48448/cbk7-z574
BibTeX
@article{2025,
author = {2025, Cognitive Science Society and Li, Zhaobin and Steyvers, Mark},
title = {The Importance of Metacognitive Sensitivity in Human-AI Decision-Making},
journal = {eScholarship (California Digital Library)},
year = {2025},
doi = {10.48448/cbk7-z574}
}
EUVIMED