EUVIMEDEUVIMED entdecken
Crossref

The Importance of Metacognitive Sensitivity in Human-AI Decision-Making

Cognitive Science Society 2025, Zhaobin Li, Mark Steyvers

eScholarship (California Digital Library) · 18.06.2025

DOI: 10.48448/cbk7-z574 ↗

Kurz gefasst

Fachartikel in der Zeitschrift eScholarship (California Digital Library), erschienen am 18.06.2025. Verfasst von Cognitive Science Society 2025 und 2 weiteren Autor:innen.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In human-AI decision-making, understanding the factors that maximize overall accuracy remains a critical challenge. This study highlights the role of metacognitive sensitivity—the agent's ability to assign confidence scores that reliably distinguish between correct and incorrect predictions. We propose a theoretical framework to evaluate the impact of accuracy and metacognitive sensitivity in hybrid decision-making contexts. Our analytical results establish conditions under which an agent with lower accuracy but higher metacognitive sensitivity can enhance overall decision accuracy when paired with another agent. Empirical analyses on a real-world image classification dataset confirm that stronger metacognitive sensitivity—whether in AI or human agents—can improve joint decision outcomes. These findings advocate for a more comprehensive approach to evaluating AI and human collaborators, emphasizing the joint optimization of accuracy and metacognitive sensitivity for enhanced decision-making.

Schlagwörter

metacognitive sensitivityhuman-AI decision-makingconfidence calibrationhybrid decision-makinghuman-AI collaborationimage classification

Zitieren

APA

2025, C. S. S., Li, Z., & Steyvers, M. (2025). The Importance of Metacognitive Sensitivity in Human-AI Decision-Making. eScholarship (California Digital Library). https://doi.org/10.48448/cbk7-z574

Vancouver

2025 CSS, Li Z, Steyvers M. The Importance of Metacognitive Sensitivity in Human-AI Decision-Making. eScholarship (California Digital Library). 2025. doi:10.48448/cbk7-z574

BibTeX
@article{2025,
  author = {2025, Cognitive Science Society and Li, Zhaobin and Steyvers, Mark},
  title = {The Importance of Metacognitive Sensitivity in Human-AI Decision-Making},
  journal = {eScholarship (California Digital Library)},
  year = {2025},
  doi = {10.48448/cbk7-z574}
}
Kostenlos starten →