Multi-Metric Trustworthiness Evaluation of AI-Assisted Medical Imaging Diagnosis: Integrating Confidence Calibration and Distribution Shift Detection
Journal of Global Engineering Review · 26.01.2026 · 4 (1) · 113-126
DOI: 10.66372/jger.v4i1.8 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Global Engineering Review, online erschienen am 26.01.2026. Verfasst von Yanhuan Chen und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The rapid proliferation of artificial intelligence in medical imaging diagnosis has created an urgent need for comprehensive trustworthiness evaluation frameworks. This study proposes a multi-metric evaluation methodology that integrates confidence calibration assessment with distribution shift detection to address the critical challenge of silent failures in deployed AI diagnostic systems. The proposed framework encompasses Expected Calibration Error measurement across demographic subgroups, statistical distance-based distribution shift detection in deep feature spaces, and a novel trustworthiness scorecard that synthesizes prediction confidence, distributional similarity, and historical accuracy metrics. Experimental validation across three chest radiograph datasets demonstrates that the integrated evaluation approach identifies 23.7% more potentially unreliable predictions compared to single-metric methods while maintaining clinical utility. The framework provides actionable insights for FDA postmarket surveillance requirements and supports evidence-based clinical AI governance strategies.
Zitieren
APA
Chen, Y., & Lai, J. (2026). Multi-Metric Trustworthiness Evaluation of AI-Assisted Medical Imaging Diagnosis: Integrating Confidence Calibration and Distribution Shift Detection. Journal of Global Engineering Review, 4(1), 113-126. https://doi.org/10.66372/jger.v4i1.8
Vancouver
Chen Y, Lai J. Multi-Metric Trustworthiness Evaluation of AI-Assisted Medical Imaging Diagnosis: Integrating Confidence Calibration and Distribution Shift Detection. Journal of Global Engineering Review. 2026;4(1):113-126. doi:10.66372/jger.v4i1.8
BibTeX
@article{Chen2026,
author = {Chen, Yanhuan and Lai, Jiawen},
title = {Multi-Metric Trustworthiness Evaluation of AI-Assisted Medical Imaging Diagnosis: Integrating Confidence Calibration and Distribution Shift Detection},
journal = {Journal of Global Engineering Review},
year = {2026},
volume = {4},
number = {1},
pages = {113--126},
doi = {10.66372/jger.v4i1.8}
}
EUVIMED