EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Clinical Application of Vision Transformers for Melanoma Classification: A Multi-Dataset Evaluation Study

Antony Garcia iD, Jixing Zhou iD, Gabriela Pinero-Crespo iD, Thomas Beachkofsky iD, Xinming Huang iD

Cancers · 28.10.2025 · 17 (21) · 3447

DOI: 10.3390/cancers17213447 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cancers, online erschienen am 28.10.2025. Verfasst von Antony Garcia und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, Worcester Polytechnic Institute, Worcester, MA 01609, USA. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Melanoma is one of the most lethal skin cancers, with survival rates largely dependent on early detection, yet diagnosis remains difficult because of its visual similarity to benign nevi. Convolutional neural networks have achieved strong performance in dermoscopic analysis but often depend on fixed input sizes and local features, which can limit generalization. Vision Transformers, which capture global image relationships through self-attention, offer a promising alternative.

Methods

A ViT-L/16 model was fine-tuned using the ISIC 2019 dataset containing more than 25,000 dermoscopic images. To expand the dataset and balance class representation, synthetic melanoma and nevus images were produced with StyleGAN2-ADA, retaining only high-confidence outputs. Model performance was evaluated on an external biopsy-confirmed dataset (MN187) and compared with CNN baselines (ResNet-152, DenseNet-201, EfficientNet-B7, ConvNeXt-XL, ViT-B/16) and the commercial MoleAnalyzer Pro system using ROC-AUC and DeLong’s test.

Results

The ViT-L/16 model reached a baseline ROC-AUC of 0.902 on MN187, surpassing all CNN baselines and the MoleAnalyzer Pro system, though the difference was not statistically significant (p = 0.07). After adding 46,000 confidence-filtered GAN-generated images, the ROC-AUC increased to 0.915, giving a statistically significant improvement over the commercial MoleAnalyzer Pro system (p = 0.032).

Conclusions

Vision Transformers show strong potential for melanoma classification, especially when combined with GAN-based augmentation, offering advantages in global feature representation and data expansion that support the development of dependable AI-driven clinical decision-support systems.

Schlagwörter

Stichwörter der Autor:innen

Vision Transformerdeep learningdermoscopymedical imagingmelanomaskin cancer

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, Worcester Polytechnic Institute, Worcester, MA 01609, USA.
  • Facultad de Ingeniería Eléctrica, Universidad Tecnológica de Panamá, Avenida Universidad Tecnológica de Panamá, Panamá 0819-0728, Panama.
  • College of Medicine, University of South Florida Morsani, Tampa, FL 33602, USA.
  • Dermatology Service, James A. Haley Veterans Hospital, Tampa, FL 33637, USA.

ORCID-Profile: Antony Garcia, Jixing Zhou, Gabriela Pinero-Crespo, Thomas Beachkofsky, Xinming Huang

Zitieren

APA

Garcia, A., Zhou, J., Pinero-Crespo, G., Beachkofsky, T., & Huang, X. (2025). Clinical Application of Vision Transformers for Melanoma Classification: A Multi-Dataset Evaluation Study. Cancers, 17(21), 3447. https://doi.org/10.3390/cancers17213447

Vancouver

Garcia A, Zhou J, Pinero-Crespo G, Beachkofsky T, Huang X. Clinical Application of Vision Transformers for Melanoma Classification: A Multi-Dataset Evaluation Study. Cancers. 2025;17(21):3447. doi:10.3390/cancers17213447

BibTeX
@article{Garcia2025,
  author = {Garcia, Antony and Zhou, Jixing and Pinero-Crespo, Gabriela and Beachkofsky, Thomas and Huang, Xinming},
  title = {Clinical Application of Vision Transformers for Melanoma Classification: A Multi-Dataset Evaluation Study},
  journal = {Cancers},
  year = {2025},
  volume = {17},
  number = {21},
  pages = {3447},
  doi = {10.3390/cancers17213447}
}
Kostenlos starten →