CViTF-Net: A Convolutional and Visual Transformer Fusion Network for Small Ship Target Detection in Synthetic Aperture Radar Images
Remote Sensing · 05.09.2023 · 15 (18) · 4373
DOI: 10.3390/rs15184373 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 05.09.2023. Verfasst von Min Huang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Foundation of Hebei Technology Innovation Center of Intelligent IoT, Defense Industrial Technology Development Program.
Abstract (Originalsprache)
Detecting small ship targets in large-scale synthetic aperture radar (SAR) images with complex backgrounds is challenging. This difficulty arises due to indistinct visual features and noise interference. To address these issues, we propose a novel two-stage detector, namely a convolutional and visual transformer fusion network (CViTF-Net), and enhance its detection performance through three innovative modules. Firstly, we designed a pyramid structured CViT backbone. This design leverages convolutional blocks to extract low-level and local features, while utilizing transformer blocks to capture inter-object dependencies over larger image regions. As a result, the CViT backbone adeptly integrates local and global information to bolster the feature representation capacity of targets. Subsequently, we proposed the Gaussian prior discrepancy (GPD) assigner. This assigner employs the discrepancy of Gaussian distributions in two dimensions to assess the degree of matching between priors and ground truth values, thus refining the discriminative criteria for positive and negative samples. Lastly, we designed the level synchronized attention mechanism (LSAM). This mechanism simultaneously considers information from multiple layers in region of interest (RoI) feature maps, and adaptively adjusts the weights of diverse regions within the final RoI. As a result, it enhances the capability to capture both target details and contextual information. We achieved the highest comprehensive evaluation results for the public LS-SSDD-v1.0 dataset, with an mAP of 79.7% and an F1 of 80.8%. In addition, the robustness of the CViTF-Net was validated using the public SSDD dataset. Visualization of the experimental results indicated that CViTF-Net can effectively enhance the detection performance for small ship targets in complex scenes.
Förderung
- Foundation of Hebei Technology Innovation Center of Intelligent IoT
- Defense Industrial Technology Development Program
Zitieren
APA
Huang, M., Liu, T., & Chen, Y. (2023). CViTF-Net: A Convolutional and Visual Transformer Fusion Network for Small Ship Target Detection in Synthetic Aperture Radar Images. Remote Sensing, 15(18), 4373. https://doi.org/10.3390/rs15184373
Vancouver
Huang M, Liu T, Chen Y. CViTF-Net: A Convolutional and Visual Transformer Fusion Network for Small Ship Target Detection in Synthetic Aperture Radar Images. Remote Sensing. 2023;15(18):4373. doi:10.3390/rs15184373
BibTeX
@article{Huang2023,
author = {Huang, Min and Liu, Tianen and Chen, Yazhou},
title = {CViTF-Net: A Convolutional and Visual Transformer Fusion Network for Small Ship Target Detection in Synthetic Aperture Radar Images},
journal = {Remote Sensing},
year = {2023},
volume = {15},
number = {18},
pages = {4373},
doi = {10.3390/rs15184373}
}
EUVIMED