MCPT: Mixed Convolutional Parallel Transformer for Polarimetric SAR Image Classification
Remote Sensing · 05.06.2023 · 15 (11) · 2936
DOI: 10.3390/rs15112936 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 05.06.2023. Verfasst von Wenke Wang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Doctoral Foundation of Henan Polytechnic University, Henan Provincial Science and Technology Research Project.
Abstract (Originalsprache)
Vision transformers (ViT) have the characteristics of massive training data and complex model, which cannot be directly applied to polarimetric synthetic aperture radar (PolSAR) image classification tasks. Therefore, a mixed convolutional parallel transformer (MCPT) model based on ViT is proposed for fast PolSAR image classification. First of all, a mixed depthwise convolution tokenization is introduced. It replaces the learnable linear projection in the original ViT to obtain patch embeddings. The process of tokenization can reduce computational and parameter complexity and extract features of different receptive fields as input to the encoder. Furthermore, combining the idea of shallow networks with lower latency and easier optimization, a parallel encoder is implemented by pairing the same modules and recombining to form parallel blocks, which can decrease the network depth and computing power requirement. In addition, the original class embedding and position embedding are removed during tokenization, and a global average pooling layer is added after the encoder for category feature extraction. Finally, the experimental results on AIRSAR Flevoland and RADARSAT-2 San Francisco datasets show that the proposed method achieves a significant improvement in training and prediction speed. Meanwhile, the overall accuracy achieved was 97.9% and 96.77%, respectively.
Förderung
- National Natural Science Foundation of China
- Doctoral Foundation of Henan Polytechnic University
- Henan Provincial Science and Technology Research Project
- Key Research Project Fund of Institution of Higher Education in Henan Province
Zitieren
APA
Wang, W., Wang, J., Lu, B., Liu, B., Zhang, Y., & Wang, C. (2023). MCPT: Mixed Convolutional Parallel Transformer for Polarimetric SAR Image Classification. Remote Sensing, 15(11), 2936. https://doi.org/10.3390/rs15112936
Vancouver
Wang W, Wang J, Lu B, Liu B, Zhang Y, Wang C. MCPT: Mixed Convolutional Parallel Transformer for Polarimetric SAR Image Classification. Remote Sensing. 2023;15(11):2936. doi:10.3390/rs15112936
BibTeX
@article{Wang2023,
author = {Wang, Wenke and Wang, Jianlong and Lu, Bibo and Liu, Boyuan and Zhang, Yake and Wang, Chunyang},
title = {MCPT: Mixed Convolutional Parallel Transformer for Polarimetric SAR Image Classification},
journal = {Remote Sensing},
year = {2023},
volume = {15},
number = {11},
pages = {2936},
doi = {10.3390/rs15112936}
}
EUVIMED