EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing Clinician Trust in AI Diagnostics: A Dynamic Framework for Confidence Calibration and Transparency

Yunguo Yu iD, Cesar A Gomez-Cabello iD, Syed Ali Haider iD, Ariana Genovese iD, Srinivasagam Prabha iD, Maissa Trabilsy, Bernardo G Collaco iD, Nadia G Wood iD, Sanjay Bagaria, Cui Tao iD, Antonio J Forte iD

Diagnostics · 30.08.2025 · 15 (17) · 2204

DOI: 10.3390/diagnostics15172204 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Diagnostics, online erschienen am 30.08.2025. Verfasst von Yunguo Yu und 10 weiteren Autor:innen. Beteiligte Einrichtung: Zyter|TruCare, Rockville, MD 20852, USA. Die Arbeit wurde bisher 32-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Artificial Intelligence (AI)-driven Decision Support Systems (DSSs) promise improvements in diagnostic accuracy and clinical workflow efficiency, but their adoption is hindered by inadequate confidence calibration, limited transparency, and poor alignment with real-world decision processes, which limit clinician trust and lead to high override rates.

Methods

We developed and validated a dynamic scoring framework to enhance trust in AI-generated diagnoses by integrating AI confidence scores, semantic similarity measures, and transparency weighting into the override decision process using 6689 cardiovascular cases from the MIMIC-III dataset. Override thresholds were calibrated and validated across varying transparency and confidence levels, with override rate as the primary acceptance measure.

Results

The implementation of this framework reduced the override rate to 33.29%, with high-confidence predictions (90–99%) overridden at a rate of only 1.7%, and low-confidence predictions (70–79%) at a rate of 99.3%. Minimal transparency diagnoses had a 73.9% override rate compared to 49.3% for moderate transparency. Statistical analyses confirmed significant associations between confidence, transparency, and override rates (p < 0.001).

Conclusions

These findings suggest that enhanced transparency and confidence calibration can substantially reduce override rates and promote clinician acceptance of AI diagnostics. Future work should focus on clinical validation to optimize patient safety, diagnostic accuracy, and efficiency.

Schlagwörter

Stichwörter der Autor:innen

AI decision support systemsAI transparencyclinician trustconfidence calibration

Autor:innen und Institutionen

  • Zyter|TruCare, Rockville, MD 20852, USA.
  • Division of Plastic Surgery, Mayo Clinic, Jacksonville, FL 32224, USA.
  • Department of Radiology AI IT, Mayo Clinic, Rochester, MN 55905, USA.
  • Division of Surgical Oncology, Mayo Clinic, Jacksonville, FL 32224, USA.
  • Department of Artificial Intelligence and Informatics, Mayo Clinic, Jacksonville, FL 32224, USA.
  • Center for Digital Health, Mayo Clinic, Rochester, MN 55905, USA.

ORCID-Profile: Yunguo Yu, Cesar A Gomez-Cabello, Syed Ali Haider, Ariana Genovese, Srinivasagam Prabha, Bernardo G Collaco, Nadia G Wood, Cui Tao, Antonio J Forte

Zitieren

APA

Yu, Y., Gomez-Cabello, C. A., Haider, S. A., Genovese, A., Prabha, S., Trabilsy, M., Collaco, B. G., Wood, N. G., Bagaria, S., Tao, C., & Forte, A. J. (2025). Enhancing Clinician Trust in AI Diagnostics: A Dynamic Framework for Confidence Calibration and Transparency. Diagnostics, 15(17), 2204. https://doi.org/10.3390/diagnostics15172204

Vancouver

Yu Y, Gomez-Cabello CA, Haider SA, Genovese A, Prabha S, Trabilsy M, et al. Enhancing Clinician Trust in AI Diagnostics: A Dynamic Framework for Confidence Calibration and Transparency. Diagnostics. 2025;15(17):2204. doi:10.3390/diagnostics15172204

BibTeX
@article{Yu2025,
  author = {Yu, Yunguo and Gomez-Cabello, Cesar A and Haider, Syed Ali and Genovese, Ariana and Prabha, Srinivasagam and Trabilsy, Maissa and Collaco, Bernardo G and Wood, Nadia G and Bagaria, Sanjay and Tao, Cui and Forte, Antonio J},
  title = {Enhancing Clinician Trust in AI Diagnostics: A Dynamic Framework for Confidence Calibration and Transparency},
  journal = {Diagnostics},
  year = {2025},
  volume = {15},
  number = {17},
  pages = {2204},
  doi = {10.3390/diagnostics15172204}
}
Kostenlos starten →