EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluating Explainability: A Framework for Systematic Assessment of Explainable AI Features in Medical Imaging

Miguel A Lago iD, Ghada Zamzmi iD, Brandon Eich, Jana G Delfino iD

Bioengineering · 16.01.2026 · 13 (1) · 111

DOI: 10.3390/bioengineering13010111 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioengineering, online erschienen am 16.01.2026. Verfasst von Miguel A Lago und 3 weiteren Autor:innen. Beteiligte Einrichtung: Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Healt…. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Explainability features are intended to provide insight into the internal mechanisms of an Artificial Intelligence (AI) device, but there is a lack of evaluation techniques for assessing the quality of provided explanations. We propose a framework to assess and report explainable AI features in medical images. Our evaluation framework for AI explainability is based on four criteria that relate to the particular needs in AI-enabled medical devices: (1) Consistency quantifies the variability of explanations to similar inputs; (2) plausibility estimates how close the explanation is to the ground truth; (3) fidelity assesses the alignment between the explanation and the model internal mechanisms; and (4) usefulness evaluates the impact on task performance of the explanation. Finally, we developed a scorecard for AI explainability methods in medical imaging that serves as a complete description and evaluation to accompany this type of device. We describe these four criteria and give examples on how they can be evaluated. As a case study, we use Ablation CAM and Eigen CAM to illustrate the evaluation of explanation heatmaps on the detection of breast lesions on synthetic mammographies. The first three criteria are evaluated for task-relevant scenarios. This framework establishes criteria through which the quality of explanations provided by medical devices can be quantified.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligenceexplainabilityheatmapsinterpretabilitymedical imagingtransparency

Autor:innen und Institutionen

  • Division of Imaging, Diagnostics, and Software Reliability, Office of Science and Engineering Laboratories, Center for Devices and Radiological Health, U.S. Food and Drug Administration, Silver Spring, MD 20993, USA.

ORCID-Profile: Miguel A Lago, Ghada Zamzmi, Jana G Delfino

Zitieren

APA

Lago, M. A., Zamzmi, G., Eich, B., & Delfino, J. G. (2026). Evaluating Explainability: A Framework for Systematic Assessment of Explainable AI Features in Medical Imaging. Bioengineering, 13(1), 111. https://doi.org/10.3390/bioengineering13010111

Vancouver

Lago MA, Zamzmi G, Eich B, Delfino JG. Evaluating Explainability: A Framework for Systematic Assessment of Explainable AI Features in Medical Imaging. Bioengineering. 2026;13(1):111. doi:10.3390/bioengineering13010111

BibTeX
@article{Lago2026,
  author = {Lago, Miguel A and Zamzmi, Ghada and Eich, Brandon and Delfino, Jana G},
  title = {Evaluating Explainability: A Framework for Systematic Assessment of Explainable AI Features in Medical Imaging},
  journal = {Bioengineering},
  year = {2026},
  volume = {13},
  number = {1},
  pages = {111},
  doi = {10.3390/bioengineering13010111}
}
Kostenlos starten →