EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Weak Calibration Cross-Fusion Framework for Multi-Modal 3D Object Detection on Unmanned Surface Vehicles

Yong Li, Dehang Lian, Jialong Du, Dongxu Gao, Xiangrong Xu, Xiang Gong

Journal of Marine Science and Engineering · 06.05.2026 · 14 (9) · 867

DOI: 10.3390/jmse14090867 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Marine Science and Engineering, online erschienen am 06.05.2026. Verfasst von Yong Li und 5 weiteren Autor:innen. Die Arbeit nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: 2025 Guangxi Xianghai Economic Talent Training Support Special Project “Guangxi Coral Reef Intelligent Monitoring Technology Research and Development and Talen…, Guangxi Key Research and Development Project, 2025 Guangxi Graduate Education Innovation Plan.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The field of intelligent transportation on inland waterways is experiencing rapid growth, driven by the global pursuit of enhanced waterway safety, operational efficiency, and environmental sustainability. In real-world autonomous operation scenarios of unmanned surface vehicles (USVs), image-based 2D object detection methods are insufficient to meet the demands of 3D environmental modeling and accurate perception of dynamic objects. Existing 3D perception systems for USVs depend heavily on precise sensor calibration. However, projection offsets between point clouds and images—caused by water surface fluctuations and complex outdoor environments—hinder the practical deployment of these methods. To address these limitations, we propose a weak calibration multi-modal 3D object detection algorithm based on cross-view fusion, termed RCF-Free (Radar-Camera Fusion, Free from precise calibration). Inspired by autonomous driving solutions, we design a Triple-Path Cross-View Fusion module that achieves high-quality cross-view feature fusion without requiring accurate calibration parameters, while simultaneously detecting complete bird’s-eye view (BEV) bounding boxes. We further enhance the spatial layout comprehension of the visual branch through a Mobile Self-Attention Module (MAM) and effectively encode sparse point cloud features in BEV space using a dedicated BEV-Point feature encoder. Additionally, we reconstruct and introduce two water-related 3D object detection datasets, FloW-BEV and WaterScenes-BEV. Experimental results demonstrate that RCF-Free achieves mAPBEV50 scores of 60.5% and 69.3% on the FloW-BEV and WaterScenes-BEV datasets, respectively, showing the effectiveness in water surface object detection. Moreover, on the DAIR-V2X-I dataset for autonomous driving scenarios, the model attains mAP3D50 scores of 73.3%, 61.2%, and 61.2% across three task difficulty levels, illustrating strong cross-domain generalization capability.

Förderung

  • 2025 Guangxi Xianghai Economic Talent Training Support Special Project “Guangxi Coral Reef Intelligent Monitoring Technology Research and Development and Talen…
  • Guangxi Key Research and Development Project
  • 2025 Guangxi Graduate Education Innovation Plan
  • Science Research Project of Hebei Education Department
  • Key Laboratories of Sensing and Application of Intelligent Optoe-lectronic System in Sichuan Provincial Universities

Zitieren

APA

Li, Y., Lian, D., Du, J., Gao, D., Xu, X., & Gong, X. (2026). Weak Calibration Cross-Fusion Framework for Multi-Modal 3D Object Detection on Unmanned Surface Vehicles. Journal of Marine Science and Engineering, 14(9), 867. https://doi.org/10.3390/jmse14090867

Vancouver

Li Y, Lian D, Du J, Gao D, Xu X, Gong X. Weak Calibration Cross-Fusion Framework for Multi-Modal 3D Object Detection on Unmanned Surface Vehicles. Journal of Marine Science and Engineering. 2026;14(9):867. doi:10.3390/jmse14090867

BibTeX
@article{Li2026,
  author = {Li, Yong and Lian, Dehang and Du, Jialong and Gao, Dongxu and Xu, Xiangrong and Gong, Xiang},
  title = {Weak Calibration Cross-Fusion Framework for Multi-Modal 3D Object Detection on Unmanned Surface Vehicles},
  journal = {Journal of Marine Science and Engineering},
  year = {2026},
  volume = {14},
  number = {9},
  pages = {867},
  doi = {10.3390/jmse14090867}
}
Kostenlos starten →