Evaluating Explainability: A Framework for Systematic Assessment of Explainable AI Features in Medical Imaging
Bioengineering · 16.01.2026 · 13 (1) · 111
DOI: 10.3390/bioengineering13010111 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bioengineering, online erschienen am 16.01.2026. Verfasst von Miguel A Lago und 3 weiteren Autor:innen. Beteiligte Einrichtung: Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Healt…. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Explainability features are intended to provide insight into the internal mechanisms of an Artificial Intelligence (AI) device, but there is a lack of evaluation techniques for assessing the quality of provided explanations. We propose a framework to assess and report explainable AI features in medical images. Our evaluation framework for AI explainability is based on four criteria that relate to the particular needs in AI-enabled medical devices: (1) Consistency quantifies the variability of explanations to similar inputs; (2) plausibility estimates how close the explanation is to the ground truth; (3) fidelity assesses the alignment between the explanation and the model internal mechanisms; and (4) usefulness evaluates the impact on task performance of the explanation. Finally, we developed a scorecard for AI explainability methods in medical imaging that serves as a complete description and evaluation to accompany this type of device. We describe these four criteria and give examples on how they can be evaluated. As a case study, we use Ablation CAM and Eigen CAM to illustrate the evaluation of explanation heatmaps on the detection of breast lesions on synthetic mammographies. The first three criteria are evaluated for task-relevant scenarios. This framework establishes criteria through which the quality of explanations provided by medical devices can be quantified.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, USA.
ORCID-Profile: Miguel A Lago, Ghada Zamzmi, Jana G Delfino
Zitieren
APA
Lago, M. A., Zamzmi, G., Eich, B., & Delfino, J. G. (2026). Evaluating Explainability: A Framework for Systematic Assessment of Explainable AI Features in Medical Imaging. Bioengineering, 13(1), 111. https://doi.org/10.3390/bioengineering13010111
Vancouver
Lago MA, Zamzmi G, Eich B, Delfino JG. Evaluating Explainability: A Framework for Systematic Assessment of Explainable AI Features in Medical Imaging. Bioengineering. 2026;13(1):111. doi:10.3390/bioengineering13010111
BibTeX
@article{Lago2026,
author = {Lago, Miguel A and Zamzmi, Ghada and Eich, Brandon and Delfino, Jana G},
title = {Evaluating Explainability: A Framework for Systematic Assessment of Explainable AI Features in Medical Imaging},
journal = {Bioengineering},
year = {2026},
volume = {13},
number = {1},
pages = {111},
doi = {10.3390/bioengineering13010111}
}
EUVIMED