EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Novel Multi-Feature Fusion Model Based on Pre-Trained Wav2vec 2.0 for Underwater Acoustic Target Recognition

Zijun Pu, Qunfei Zhang, Yangtao Xue, Peican Zhu, Xiaodong Cui

Remote Sensing · 03.07.2024 · 16 (13) · 2442

DOI: 10.3390/rs16132442 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 03.07.2024. Verfasst von Zijun Pu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Although recent data-driven Underwater Acoustic Target Recognition (UATR) methods have played a dominant role in marine acoustics, they suffer from complex ocean environments and rather small datasets. To tackle such challenges, researchers have resorted to transfer learning in an effort to fulfill UATR tasks. However, existing pre-trained models are trained on audio speech data, and are not suitable for underwater acoustic data. Therefore, it is necessary to make further optimization on the basis of these models to make them suitable for the UATR task. Here, we propose a novel UATR framework called Attention Layer Supplement Integration (ALSI), which integrates large pre-trained neural networks with customized attention modules for acoustic. Specifically, the ALSI model consists of two important modules, namely Scale ResNet and Residual Hybrid Attention Fusion (RHAF). First, the Scale ResNet module takes the Constant-Q transform feature as input to obtain relatively important frequency information. Next, RHAF takes the temporal feature extracted by wav2vec 2.0 and the frequency feature extracted by Scale ResNet as input and aims to better integrate the time–frequency features with the temporal feature by using the attention mechanism. The RHAF module can help wav2vec 2.0, which is trained on speech data, to better adapt to underwater acoustic data. Finally, the experiments on the ShipsEar dataset demonstrated that our model can achieve recognition accuracy of 96.39%. In conclusion, extensive experiments confirm the effectiveness of our model on the UATR task.

Zitieren

APA

Pu, Z., Zhang, Q., Xue, Y., Zhu, P., & Cui, X. (2024). A Novel Multi-Feature Fusion Model Based on Pre-Trained Wav2vec 2.0 for Underwater Acoustic Target Recognition. Remote Sensing, 16(13), 2442. https://doi.org/10.3390/rs16132442

Vancouver

Pu Z, Zhang Q, Xue Y, Zhu P, Cui X. A Novel Multi-Feature Fusion Model Based on Pre-Trained Wav2vec 2.0 for Underwater Acoustic Target Recognition. Remote Sensing. 2024;16(13):2442. doi:10.3390/rs16132442

BibTeX
@article{Pu2024,
  author = {Pu, Zijun and Zhang, Qunfei and Xue, Yangtao and Zhu, Peican and Cui, Xiaodong},
  title = {A Novel Multi-Feature Fusion Model Based on Pre-Trained Wav2vec 2.0 for Underwater Acoustic Target Recognition},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {13},
  pages = {2442},
  doi = {10.3390/rs16132442}
}
Kostenlos starten →