Skin Cancer Segmentation and Classification Using Vision Transformer for Automatic Analysis in Dermatoscopy-Based Noninvasive Digital System
International Journal of Biomedical Imaging · 03.02.2024 · 2024 · 1-18
DOI: 10.1155/2024/3022192 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Biomedical Imaging, erschienen am 03.02.2024. Verfasst von Galib Muhammad Shahriar Himel und 4 weiteren Autor:innen. Beteiligte Einrichtung: Jahangirnagar University, Dhaka, Bangladesh. Die Arbeit wurde bisher 118-mal zitiert (Crossref) und nennt 85 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Skin cancer is a significant health concern worldwide, and early and accurate diagnosis plays a crucial role in improving patient outcomes. In recent years, deep learning models have shown remarkable success in various computer vision tasks, including image classification. In this research study, we introduce an approach for skin cancer classification using vision transformer, a state-of-the-art deep learning architecture that has demonstrated exceptional performance in diverse image analysis tasks. The study utilizes the HAM10000 dataset; a publicly available dataset comprising 10,015 skin lesion images classified into two categories: benign (6705 images) and malignant (3310 images). This dataset consists of high-resolution images captured using dermatoscopes and carefully annotated by expert dermatologists. Preprocessing techniques, such as normalization and augmentation, are applied to enhance the robustness and generalization of the model. The vision transformer architecture is adapted to the skin cancer classification task. The model leverages the self-attention mechanism to capture intricate spatial dependencies and long-range dependencies within the images, enabling it to effectively learn relevant features for accurate classification. Segment Anything Model (SAM) is employed to segment the cancerous areas from the images; achieving an IOU of 96.01% and Dice coefficient of 98.14% and then various pretrained models are used for classification using vision transformer architecture. Extensive experiments and evaluations are conducted to assess the performance of our approach. The results demonstrate the superiority of the vision transformer model over traditional deep learning architectures in skin cancer classification in general with some exceptions. Upon experimenting on six different models, ViT-Google, ViT-MAE, ViT-ResNet50, ViT-VAN, ViT-BEiT, and ViT-DiT, we found out that the ML approach achieves 96.15% accuracy using Google’s ViT patch-32 model with a low false negative ratio on the test dataset, showcasing its potential as an effective tool for aiding dermatologists in the diagnosis of skin cancer.
Autor:innen und Institutionen
- Jahangirnagar University, Dhaka, Bangladesh.
- Bangladesh University of Health Sciences, Dhaka, Bangladesh.
- Bangabandhu Sheikh Mujib Medical University, Dhaka, Bangladesh.
ORCID-Profile: Galib Muhammad Shahriar Himel, Md Masudul Islam, Kh Abdullah Al-Aff, Shams Ibne Karim, Md Kabir Uddin Sikder
Zitieren
APA
Himel, G. M. S., Islam, M. M., Al-Aff, K. A., Karim, S. I., & Sikder, M. K. U. (2024). Skin Cancer Segmentation and Classification Using Vision Transformer for Automatic Analysis in Dermatoscopy-Based Noninvasive Digital System. International Journal of Biomedical Imaging, 2024, 1-18. https://doi.org/10.1155/2024/3022192
Vancouver
Himel GMS, Islam MM, Al-Aff KA, Karim SI, Sikder MKU. Skin Cancer Segmentation and Classification Using Vision Transformer for Automatic Analysis in Dermatoscopy-Based Noninvasive Digital System. International Journal of Biomedical Imaging. 2024;2024:1-18. doi:10.1155/2024/3022192
BibTeX
@article{Himel2024,
author = {Himel, Galib Muhammad Shahriar and Islam, Md Masudul and Al-Aff, Kh Abdullah and Karim, Shams Ibne and Sikder, Md Kabir Uddin},
title = {Skin Cancer Segmentation and Classification Using Vision Transformer for Automatic Analysis in Dermatoscopy-Based Noninvasive Digital System},
journal = {International Journal of Biomedical Imaging},
year = {2024},
volume = {2024},
pages = {1--18},
doi = {10.1155/2024/3022192}
}
EUVIMED