EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

CNN–Transformer Hybrid Architecture for Underwater Sonar Image Segmentation

Juan Lei, Huigang Wang, Zelin Lei, Jiayuan Li, Shaowei Rong

Remote Sensing · 19.02.2025 · 17 (4) · 707

DOI: 10.3390/rs17040707 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 19.02.2025. Verfasst von Juan Lei und 4 weiteren Autor:innen. Die Arbeit wurde bisher 26-mal zitiert (Crossref) und nennt 85 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation of China, Science, Technology and Innovation of Shenzhen Municipality.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The salient object detection (SOD) of forward-looking sonar images plays a crucial role in underwater detection and rescue tasks. However, the existing SOD algorithms find it difficult to effectively extract salient features and spatial structure information from images with scarce semantic information, uneven intensity distribution, and high noise. Convolutional neural networks (CNNs) have strong local feature extraction capabilities, but they are easily constrained by the receptive field and lack the ability to model long-range dependencies. Transformers, with their powerful self-attention mechanism, are capable of modeling the global features of a target, but they tend to lose a significant amount of local detail. Mamba effectively models long-range dependencies in long sequence inputs through a selection mechanism, offering a novel approach to capturing long-range correlations between pixels. However, since the saliency of image pixels does not exhibit sequential dependencies, this somewhat limits Mamba’s ability to fully capture global contextual information during the forward pass. Inspired by multimodal feature fusion learning, we propose a hybrid CNN–Transformer–Mamba architecture, termed FLSSNet. FLSSNet is built upon a CNN and Transformer backbone network, integrating four core submodules to address various technical challenges: (1) The asymmetric dual encoder–decoder (ADED) is capable of simultaneously extracting features from different modalities and systematically modeling both local contextual information and global spatial structure. (2) The Transformer feature converter (TFC) module optimizes the multimodal feature fusion process through feature transformation and channel compression. (3) The long-range correlation attention (LRCA) module enhances CNN’s ability to model long-range dependencies through the collaborative use of convolutional kernels, selective sequential scanning, and attention mechanisms, while effectively suppressing noise interference. (4) The recursive contour refinement (RCR) model refines edge contour information through a layer-by-layer recursive mechanism, achieving greater precision in boundary details. The experimental results show that FLSSNet exhibits outstanding competitiveness among 25 state-of-the-art SOD methods, achieving MAE and Eξ values of 0.04 and 0.973, respectively.

Förderung

  • National Science Foundation of China
  • Science, Technology and Innovation of Shenzhen Municipality

Zitieren

APA

Lei, J., Wang, H., Lei, Z., Li, J., & Rong, S. (2025). CNN–Transformer Hybrid Architecture for Underwater Sonar Image Segmentation. Remote Sensing, 17(4), 707. https://doi.org/10.3390/rs17040707

Vancouver

Lei J, Wang H, Lei Z, Li J, Rong S. CNN–Transformer Hybrid Architecture for Underwater Sonar Image Segmentation. Remote Sensing. 2025;17(4):707. doi:10.3390/rs17040707

BibTeX
@article{Lei2025,
  author = {Lei, Juan and Wang, Huigang and Lei, Zelin and Li, Jiayuan and Rong, Shaowei},
  title = {CNN–Transformer Hybrid Architecture for Underwater Sonar Image Segmentation},
  journal = {Remote Sensing},
  year = {2025},
  volume = {17},
  number = {4},
  pages = {707},
  doi = {10.3390/rs17040707}
}
Kostenlos starten →