UAMFDet: Acoustic‐Optical Fusion for Underwater Multi‐Modal Object Detection
Journal of Field Robotics · 2025-06 · 42 (4) · 970-983
DOI: 10.1002/rob.22432 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Field Robotics, online erschienen am 05.09.2024. Verfasst von Haojie Chen und 3 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 44 Literaturangaben.
Abstract (Originalsprache)
Underwater object detection serves as a crucial means for autonomous underwater vehicles (AUVs) to gain awareness of their surroundings. Currently, AUVs predominantly depend on underwater optical cameras or sonar sensing techniques to furnish vital information sources for subsequent tasks such as underwater rescue and mining exploration. However, the influence of underwater light attenuation or significant background noise often leads to the failure of either the acoustic or optical sensor. Consequently, the traditional single‐modal object detection network, which relies exclusively on either the optical or acoustic modality, struggles to adapt to the varying complexities of underwater environments. To address this challenge, this paper proposes a novel underwater acoustic‐optical fusion‐based underwater multi‐modal object detection paradigm termed UAMFDet, which fuses highly misaligned acoustic‐optical features in the spatial dimension at both the fine‐grained level and the instance level. First, we propose a multi‐modal deformable self‐aligned feature fusion module to adaptively capture feature dependencies between multi‐modal targets, and perform self‐aligned multi‐modal fine‐grained feature fusion by differential fusion. Then a multi‐modal instance‐level feature matching network is designed. It matches multi‐modal instance features by a lightweight cross‐attention mechanism and performs differential fusion to achieve instance‐level feature fusion. In addition, we establish a data set dedicated to underwater acoustic‐optical fusion object detection tasks called UAOF, and conduct a large number of experiments on the UAOF data set to verify the effectiveness of UAMFDet.
Zitieren
APA
Chen, H., Wang, Z., Qin, H., & Mu, X. (2025). UAMFDet: Acoustic‐Optical Fusion for Underwater Multi‐Modal Object Detection. Journal of Field Robotics, 42(4), 970-983. https://doi.org/10.1002/rob.22432
Vancouver
Chen H, Wang Z, Qin H, Mu X. UAMFDet: Acoustic‐Optical Fusion for Underwater Multi‐Modal Object Detection. Journal of Field Robotics. 2025;42(4):970-983. doi:10.1002/rob.22432
BibTeX
@article{Chen2025,
author = {Chen, Haojie and Wang, Zhuo and Qin, Hongde and Mu, Xiaokai},
title = {UAMFDet: Acoustic‐Optical Fusion for Underwater Multi‐Modal Object Detection},
journal = {Journal of Field Robotics},
year = {2025},
volume = {42},
number = {4},
pages = {970--983},
doi = {10.1002/rob.22432}
}
EUVIMED