Skin Lesion Classification Through Test Time Augmentation and Explainable Artificial Intelligence
Journal of Imaging · 09.01.2025 · 11 (1) · 15
DOI: 10.3390/jimaging11010015 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 09.01.2025. Verfasst von Loris Cino und 3 weiteren Autor:innen. Beteiligte Einrichtung: Dipartimento di Ingegneria Informatica, Automatica, e Gestionale "Antonio Ruberti", Sapienza Università di Roma, Via Ariosto, 25, 00185 Roma, Italy. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 88 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Future Artificial Intelligence Research—FAIR CUP B53C220036 30006, HeReFaNMi (Health-Related Fake News Monitoring).
Abstract (Originalsprache)
Despite significant advancements in the automatic classification of skin lesions using artificial intelligence (AI) algorithms, skepticism among physicians persists. This reluctance is primarily due to the lack of transparency and explainability inherent in these models, which hinders their widespread acceptance in clinical settings. The primary objective of this study is to develop a highly accurate AI-based algorithm for skin lesion classification that also provides visual explanations to foster trust and confidence in these novel diagnostic tools. By improving transparency, the study seeks to contribute to earlier and more reliable diagnoses. Additionally, the research investigates the impact of Test Time Augmentation (TTA) on the performance of six Convolutional Neural Network (CNN) architectures, which include models from the EfficientNet, ResNet (Residual Network), and ResNeXt (an enhanced variant of ResNet) families. To improve the interpretability of the models’ decision-making processes, techniques such as t-distributed Stochastic Neighbor Embedding (t-SNE) and Gradient-weighted Class Activation Mapping (Grad-CAM) are employed. t-SNE is utilized to visualize the high-dimensional latent features of the CNNs in a two-dimensional space, providing insights into how the models group different skin lesion classes. Grad-CAM is used to generate heatmaps that highlight the regions of input images that influence the model’s predictions. Our findings reveal that Test Time Augmentation enhances the balanced multi-class accuracy of CNN models by up to 0.3%, achieving a balanced accuracy rate of 97.58% on the International Skin Imaging Collaboration (ISIC 2019) dataset. This performance is comparable to, or marginally better than, more complex approaches such as Vision Transformers (ViTs), demonstrating the efficacy of our methodology.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Dipartimento di Ingegneria Informatica, Automatica, e Gestionale "Antonio Ruberti", Sapienza Università di Roma, Via Ariosto, 25, 00185 Roma, Italy.
- Istituto di Scienze Applicate e Sistemi Intelligenti (ISASI), Consiglio Nazionale delle Ricerche (CNR), DHITECH, Campus Università del Salento, Via Monteroni s.n., 73100 Lecce, Italy.
- Dermatologia Myskin, Poliambulatorio Specialistico Medico-Chirurgico, 73030 Tiggiano, Italy.
ORCID-Profile: Loris Cino, Cosimo Distante, Pier Luigi Mazzeo
Förderung
- Future Artificial Intelligence Research—FAIR CUP B53C220036 30006
- HeReFaNMi (Health-Related Fake News Monitoring)
Zitieren
APA
Cino, L., Distante, C., Martella, A., & Mazzeo, P. L. (2025). Skin Lesion Classification Through Test Time Augmentation and Explainable Artificial Intelligence. Journal of Imaging, 11(1), 15. https://doi.org/10.3390/jimaging11010015
Vancouver
Cino L, Distante C, Martella A, Mazzeo PL. Skin Lesion Classification Through Test Time Augmentation and Explainable Artificial Intelligence. Journal of Imaging. 2025;11(1):15. doi:10.3390/jimaging11010015
BibTeX
@article{Cino2025,
author = {Cino, Loris and Distante, Cosimo and Martella, Alessandro and Mazzeo, Pier Luigi},
title = {Skin Lesion Classification Through Test Time Augmentation and Explainable Artificial Intelligence},
journal = {Journal of Imaging},
year = {2025},
volume = {11},
number = {1},
pages = {15},
doi = {10.3390/jimaging11010015}
}
EUVIMED