Beyond Confidence Scores: Calibrating Physician Reliance on AI Decision Support Through Localized Reliability Signals
Medical Research Archives · 30.09.2026 · 14 (9)
DOI: 10.18103/mra.2026.0563 ↗Kurz gefasst
Fachartikel in der Zeitschrift Medical Research Archives, online erschienen am 30.09.2026. Verfasst von Nikolos Gurney und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Artificial intelligence is entering clinical practice faster than we understand how physicians actually use it. Two failure modes threaten patient safety: following recommendations that are wrong, and dismissing recommendations that are right. Both stem from a mismatch between how much a clinician trusts a system and how reliable that system actually is for a given case. We argue that the information these systems provide about their own limitations is central to closing that gap. We illustrate this using results from a controlled study of 272 participants that compared five ways of communicating an AI's performance. It found that stating a system's overall accuracy, the most common approach in practice, did not improve decisions at all. What did help was providing information about the system's performance on prior cases resembling the current one. This localized reliability signal was especially valuable when the AI was wrong but confident. Notably, participants made better decisions without reporting better understanding of the system, suggesting calibration develops through exposure rather than explanation. We translate these findings into design and training recommendations for clinical decision support.
Zitieren
APA
Gurney, N., Behzad, T., Butler, A., Pynadath, D., & Wang, N. (2026). Beyond Confidence Scores: Calibrating Physician Reliance on AI Decision Support Through Localized Reliability Signals. Medical Research Archives, 14(9). https://doi.org/10.18103/mra.2026.0563
Vancouver
Gurney N, Behzad T, Butler A, Pynadath D, Wang N. Beyond Confidence Scores: Calibrating Physician Reliance on AI Decision Support Through Localized Reliability Signals. Medical Research Archives. 2026;14(9). doi:10.18103/mra.2026.0563
BibTeX
@article{Gurney2026,
author = {Gurney, Nikolos and Behzad, Tina and Butler, Alison and Pynadath, David and Wang, Ning},
title = {Beyond Confidence Scores: Calibrating Physician Reliance on AI Decision Support Through Localized Reliability Signals},
journal = {Medical Research Archives},
year = {2026},
volume = {14},
number = {9},
doi = {10.18103/mra.2026.0563}
}
EUVIMED