EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-Metric Trustworthiness Evaluation of AI-Assisted Medical Imaging Diagnosis: Integrating Confidence Calibration and Distribution Shift Detection

Yanhuan Chen, Jiawen Lai

Journal of Global Engineering Review · 26.01.2026 · 4 (1) · 113-126

DOI: 10.66372/jger.v4i1.8 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Global Engineering Review, online erschienen am 26.01.2026. Verfasst von Yanhuan Chen und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid proliferation of artificial intelligence in medical imaging diagnosis has created an urgent need for comprehensive trustworthiness evaluation frameworks. This study proposes a multi-metric evaluation methodology that integrates confidence calibration assessment with distribution shift detection to address the critical challenge of silent failures in deployed AI diagnostic systems. The proposed framework encompasses Expected Calibration Error measurement across demographic subgroups, statistical distance-based distribution shift detection in deep feature spaces, and a novel trustworthiness scorecard that synthesizes prediction confidence, distributional similarity, and historical accuracy metrics. Experimental validation across three chest radiograph datasets demonstrates that the integrated evaluation approach identifies 23.7% more potentially unreliable predictions compared to single-metric methods while maintaining clinical utility. The framework provides actionable insights for FDA postmarket surveillance requirements and supports evidence-based clinical AI governance strategies.

Zitieren

APA

Chen, Y., & Lai, J. (2026). Multi-Metric Trustworthiness Evaluation of AI-Assisted Medical Imaging Diagnosis: Integrating Confidence Calibration and Distribution Shift Detection. Journal of Global Engineering Review, 4(1), 113-126. https://doi.org/10.66372/jger.v4i1.8

Vancouver

Chen Y, Lai J. Multi-Metric Trustworthiness Evaluation of AI-Assisted Medical Imaging Diagnosis: Integrating Confidence Calibration and Distribution Shift Detection. Journal of Global Engineering Review. 2026;4(1):113-126. doi:10.66372/jger.v4i1.8

BibTeX
@article{Chen2026,
  author = {Chen, Yanhuan and Lai, Jiawen},
  title = {Multi-Metric Trustworthiness Evaluation of AI-Assisted Medical Imaging Diagnosis: Integrating Confidence Calibration and Distribution Shift Detection},
  journal = {Journal of Global Engineering Review},
  year = {2026},
  volume = {4},
  number = {1},
  pages = {113--126},
  doi = {10.66372/jger.v4i1.8}
}
Kostenlos starten →