EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

CNN and Transformer Fusion for Remote Sensing Image Semantic Segmentation

Xin Chen, Dongfen Li, Mingzhe Liu, Jiaru Jia

Remote Sensing · 10.09.2023 · 15 (18) · 4455

DOI: 10.3390/rs15184455 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 10.09.2023. Verfasst von Xin Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 58-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Semantic segmentation of remote sensing images has been widely used in environmental protection, geological disaster discovery, and natural resource assessment. With the rapid development of deep learning, convolutional neural networks (CNNs) have dominated semantic segmentation, relying on their powerful local information extraction capabilities. Due to the locality of convolution operation, it can be challenging to obtain global context information directly. However, Transformer has excellent potential in global information modeling. This paper proposes a new hybrid convolutional and Transformer semantic segmentation model called CTFuse, which uses a multi-scale convolutional attention module in the convolutional part. CTFuse is a serial structure composed of a CNN and a Transformer. It first uses convolution to extract small-size target information and then uses Transformer to embed large-size ground target information. Subsequently, we propose a spatial and channel attention module in convolution to enhance the representation ability for global information and local features. In addition, we also propose a spatial and channel attention module in Transformer to improve the ability to capture detailed information. Finally, compared to other models used in the experiments, our CTFuse achieves state-of-the-art results on the International Society of Photogrammetry and Remote Sensing (ISPRS) Vaihingen and ISPRS Potsdam datasets.

Zitieren

APA

Chen, X., Li, D., Liu, M., & Jia, J. (2023). CNN and Transformer Fusion for Remote Sensing Image Semantic Segmentation. Remote Sensing, 15(18), 4455. https://doi.org/10.3390/rs15184455

Vancouver

Chen X, Li D, Liu M, Jia J. CNN and Transformer Fusion for Remote Sensing Image Semantic Segmentation. Remote Sensing. 2023;15(18):4455. doi:10.3390/rs15184455

BibTeX
@article{Chen2023,
  author = {Chen, Xin and Li, Dongfen and Liu, Mingzhe and Jia, Jiaru},
  title = {CNN and Transformer Fusion for Remote Sensing Image Semantic Segmentation},
  journal = {Remote Sensing},
  year = {2023},
  volume = {15},
  number = {18},
  pages = {4455},
  doi = {10.3390/rs15184455}
}
Kostenlos starten →