EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Unleashing the Potential of Residual and Dual-Stream Transformers for the Remote Sensing Image Analysis

Priya Mittal iD, Vishesh Tanwar iD, Bhisham Sharma iD, Dhirendra Prasad Yadav

Journal of Imaging · 15.05.2025 · 11 (5) · 156

DOI: 10.3390/jimaging11050156 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 15.05.2025. Verfasst von Priya Mittal und 3 weiteren Autor:innen. Beteiligte Einrichtung: Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura 140401, Punjab, India. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The categorization of remote sensing satellite imagery is crucial for various applications, including environmental monitoring, urban planning, and disaster management. Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) have exhibited exceptional performance among deep learning techniques, excelling in feature extraction and representational learning. This paper presents a hybrid dual-stream ResV2ViT model that combines the advantages of ResNet50 V2 and Vision Transformer (ViT) architectures. The dual-stream approach allows the model to extract both local spatial features and global contextual information by processing data through two complementary pathways. The ResNet50V2 component is utilized for hierarchical feature extraction and captures short-range dependencies, whereas the ViT module efficiently models long-range dependencies and global contextual information. After position embedding in the hybrid model, the tokens are bifurcated into two parts: q1 and q2. q1 is passed into the convolutional block to refine local spatial details, and q2 is given to the Transformer to provide global attention to the spatial feature. Combining these two architectures allows the model to acquire low-level and high-level feature representations, improving classification performance. We assess the proposed ResV2ViT model using the RSI-CB256 dataset and another dataset with 21 classes. The proposed model attains an average accuracy of 99.91%, with precision and F1 score of 99.90% for the first dataset and 98.75% accuracy for the second dataset, illustrating its efficacy in satellite image classification. The findings demonstrate that the dual-stream hybrid ResV2ViT model surpasses traditional CNN and Transformer-based models, establishing it as a formidable framework for remote sensing applications.

Schlagwörter

Stichwörter der Autor:innen

ResNet50V2ViTattention mechanismdual-stream architecturehybrid model

Autor:innen und Institutionen

  • Chitkara University Institute of Engineering and Technology, Chitkara University, Rajpura 140401, Punjab, India.
  • Centre of Research Impact and Outcome, Chitkara University, Rajpura 140401, Punjab, India.
  • Department of Computer Engineering & Applications, G.L.A. University, Mathura 281406, Uttar Pradesh, India.

ORCID-Profile: Priya Mittal, Vishesh Tanwar, Bhisham Sharma

Zitieren

APA

Mittal, P., Tanwar, V., Sharma, B., & Yadav, D. P. (2025). Unleashing the Potential of Residual and Dual-Stream Transformers for the Remote Sensing Image Analysis. Journal of Imaging, 11(5), 156. https://doi.org/10.3390/jimaging11050156

Vancouver

Mittal P, Tanwar V, Sharma B, Yadav DP. Unleashing the Potential of Residual and Dual-Stream Transformers for the Remote Sensing Image Analysis. Journal of Imaging. 2025;11(5):156. doi:10.3390/jimaging11050156

BibTeX
@article{Mittal2025,
  author = {Mittal, Priya and Tanwar, Vishesh and Sharma, Bhisham and Yadav, Dhirendra Prasad},
  title = {Unleashing the Potential of Residual and Dual-Stream Transformers for the Remote Sensing Image Analysis},
  journal = {Journal of Imaging},
  year = {2025},
  volume = {11},
  number = {5},
  pages = {156},
  doi = {10.3390/jimaging11050156}
}
Kostenlos starten →