Vision Transformers for Image Classification: A Comparative Survey
Technologies · 12.01.2025 · 13 (1) · 32
DOI: 10.3390/technologies13010032 ↗Kurz gefasst
Fachartikel in der Zeitschrift Technologies, online erschienen am 12.01.2025. Verfasst von Yaoli Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 195-mal zitiert (Crossref) und nennt 103 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education, Singapore.
Abstract (Originalsprache)
Transformers were initially introduced for natural language processing, leveraging the self-attention mechanism. They require minimal inductive biases in their design and can function effectively as set-based architectures. Additionally, transformers excel at capturing long-range dependencies and enabling parallel processing, which allows them to outperform traditional models, such as long short-term memory (LSTM) networks, on sequence-based tasks. In recent years, transformers have been widely adopted in computer vision, driving remarkable advancements in the field. Previous surveys have provided overviews of transformer applications across various computer vision tasks, such as object detection, activity recognition, and image enhancement. In this survey, we focus specifically on image classification. We begin with an introduction to the fundamental concepts of transformers and highlight the first successful Vision Transformer (ViT). Building on the ViT, we review subsequent improvements and optimizations introduced for image classification tasks. We then compare the strengths and limitations of these transformer-based models against classic convolutional neural networks (CNNs) through experiments. Finally, we explore key challenges and potential future directions for image classification transformers.
Förderung
- Ministry of Education, Singapore
Zitieren
APA
Wang, Y., Deng, Y., Zheng, Y., Chattopadhyay, P., & Wang, L. (2025). Vision Transformers for Image Classification: A Comparative Survey. Technologies, 13(1), 32. https://doi.org/10.3390/technologies13010032
Vancouver
Wang Y, Deng Y, Zheng Y, Chattopadhyay P, Wang L. Vision Transformers for Image Classification: A Comparative Survey. Technologies. 2025;13(1):32. doi:10.3390/technologies13010032
BibTeX
@article{Wang2025,
author = {Wang, Yaoli and Deng, Yaojun and Zheng, Yuanjin and Chattopadhyay, Pratik and Wang, Lipo},
title = {Vision Transformers for Image Classification: A Comparative Survey},
journal = {Technologies},
year = {2025},
volume = {13},
number = {1},
pages = {32},
doi = {10.3390/technologies13010032}
}
EUVIMED