Explaining a deep learning based breast ultrasound image classifier with saliency maps
Journal of Ultrasonography · 13.04.2022 · 22 (89) · 70-75
DOI: 10.15557/jou.2022.0013 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Ultrasonography, online erschienen am 13.04.2022. Verfasst von Michał Byra und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Ultrasound, Institute of Fundamental Technological Research, Polish Academy of Sciences, Warsaw, Poland. Die Arbeit wurde bisher 16-mal zitiert (Crossref). Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Aim of the study: Deep neural networks have achieved good performance in breast mass classification in ultrasound imaging. However, their usage in clinical practice is still limited due to the lack of explainability of decisions conducted by the networks. In this study, to address the explainability problem, we generated saliency maps indicating ultrasound image regions important for the network’s classification decisions. Material and methods: Ultrasound images were collected from 272 breast masses, including 123 malignant and 149 benign. Transfer learning was applied to develop a deep network for breast mass classification. Next, the class activation mapping technique was used to generate saliency maps for each image. Breast mass images were divided into three regions: the breast mass region, the peritumoral region surrounding the breast mass, and the region below the breast mass. The pointing game metric was used to quantitatively assess the overlap between the saliency maps and the three selected US image regions.
Results
Deep learning classifier achieved the area under the receiver operating characteristic curve, accuracy, sensitivity, and specificity of 0.887, 0.835, 0.801, and 0.868, respectively. In the case of the correctly classified test US images, analysis of the saliency maps revealed that the decisions of the network could be associated with the three selected regions in 71% of cases.
Conclusions
Our study is an important step toward better understanding of deep learning models developed for breast mass diagnosis. We demonstrated that the decisions made by the network can be related to the appearance of certain tissue regions in breast mass US images.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Ultrasound, Institute of Fundamental Technological Research, Polish Academy of Sciences, Warsaw, Poland.
- Radiology Department II, Maria Sklodowska-Curie National Research Institute of Oncology, Warsaw, Poland.
Zitieren
APA
Byra, M., Dobruch-Sobczak, K., Piotrzkowska-Wroblewska, H., Klimonda, Z., & Litniewski, J. (2022). Explaining a deep learning based breast ultrasound image classifier with saliency maps. Journal of Ultrasonography, 22(89), 70-75. https://doi.org/10.15557/jou.2022.0013
Vancouver
Byra M, Dobruch-Sobczak K, Piotrzkowska-Wroblewska H, Klimonda Z, Litniewski J. Explaining a deep learning based breast ultrasound image classifier with saliency maps. Journal of Ultrasonography. 2022;22(89):70-75. doi:10.15557/jou.2022.0013
BibTeX
@article{Byra2022,
author = {Byra, Michał and Dobruch-Sobczak, Katarzyna and Piotrzkowska-Wroblewska, Hanna and Klimonda, Ziemowit and Litniewski, Jerzy},
title = {Explaining a deep learning based breast ultrasound image classifier with saliency maps},
journal = {Journal of Ultrasonography},
year = {2022},
volume = {22},
number = {89},
pages = {70--75},
doi = {10.15557/jou.2022.0013}
}
EUVIMED