EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Vision Transformers for Image Classification: A Comparative Survey

Yaoli Wang, Yaojun Deng, Yuanjin Zheng, Pratik Chattopadhyay, Lipo Wang

Technologies · 12.01.2025 · 13 (1) · 32

DOI: 10.3390/technologies13010032 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Technologies, online erschienen am 12.01.2025. Verfasst von Yaoli Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 195-mal zitiert (Crossref) und nennt 103 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education, Singapore.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Transformers were initially introduced for natural language processing, leveraging the self-attention mechanism. They require minimal inductive biases in their design and can function effectively as set-based architectures. Additionally, transformers excel at capturing long-range dependencies and enabling parallel processing, which allows them to outperform traditional models, such as long short-term memory (LSTM) networks, on sequence-based tasks. In recent years, transformers have been widely adopted in computer vision, driving remarkable advancements in the field. Previous surveys have provided overviews of transformer applications across various computer vision tasks, such as object detection, activity recognition, and image enhancement. In this survey, we focus specifically on image classification. We begin with an introduction to the fundamental concepts of transformers and highlight the first successful Vision Transformer (ViT). Building on the ViT, we review subsequent improvements and optimizations introduced for image classification tasks. We then compare the strengths and limitations of these transformer-based models against classic convolutional neural networks (CNNs) through experiments. Finally, we explore key challenges and potential future directions for image classification transformers.

Förderung

  • Ministry of Education, Singapore

Zitieren

APA

Wang, Y., Deng, Y., Zheng, Y., Chattopadhyay, P., & Wang, L. (2025). Vision Transformers for Image Classification: A Comparative Survey. Technologies, 13(1), 32. https://doi.org/10.3390/technologies13010032

Vancouver

Wang Y, Deng Y, Zheng Y, Chattopadhyay P, Wang L. Vision Transformers for Image Classification: A Comparative Survey. Technologies. 2025;13(1):32. doi:10.3390/technologies13010032

BibTeX
@article{Wang2025,
  author = {Wang, Yaoli and Deng, Yaojun and Zheng, Yuanjin and Chattopadhyay, Pratik and Wang, Lipo},
  title = {Vision Transformers for Image Classification: A Comparative Survey},
  journal = {Technologies},
  year = {2025},
  volume = {13},
  number = {1},
  pages = {32},
  doi = {10.3390/technologies13010032}
}
Kostenlos starten →