EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MSFNet3D: Monocular 3D Object Detection via Dual-Branch Depth-Consistent Fusion and Semantic-Guided Point Cloud Refinement

Rong Yang, Zhijie You, Renhui Luo

World Electric Vehicle Journal · 14.03.2025 · 16 (3) · 173

DOI: 10.3390/wevj16030173 ↗

Kurz gefasst

Fachartikel in der Zeitschrift World Electric Vehicle Journal, online erschienen am 14.03.2025. Verfasst von Rong Yang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Central Government Guides Local Science and Technology Development Foundation of Guangxi Zhuang Autonomous Region, Guangxi Science and Technology Major Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid development of autonomous driving has underscored the pivotal role of 3D perception. Monocular 3D object detection, as a cost-effective alternative to expensive lidar systems, is garnering increasing attention. However, existing pseudo-lidar methods encounter challenges such as coarse quality and insufficient semantic information when generating 3D point clouds from monocular images. To address these issues, this paper introduces MSFNet3D, which aims to overcome the quality limitations of pseudo-lidar point cloud. Our contributions are threefold: (1) We introduce a dual-branch network to optimize depth maps and propose a multi-scale channel spatial attention module (MS_CBAM). This module captures multi-scale geometric features through a hierarchical feature pyramid and an adaptive weight allocation mechanism, thereby addressing the scale sensitivity inherent in traditional attention mechanisms. (2) We propose a consistency-weighted fusion strategy that employs local gradient consistency analysis and differentiable weighted optimization to achieve a pixel-level fusion of image and depth features. This approach reduces feature conflicts within the dual-branch network and enhances the model’s robustness in complex scenes. (3) We introduce a semantic-guided pseudo-point cloud enhancement method that leverages an instance segmentation network to extract object-specific semantic regions and generate high-confidence point cloud, consequently improving the accuracy of object detection. Experiments on the KITTI dataset show that the proposed method performs excellently under various detection challenges, achieving an average precision of 18.87% in the 3D detection of car objects, which is a 1.67% improvement over the original model. The method also shows good performance in detecting pedestrians and cyclists. The proposed framework can provide economical and reliable 3D perception for mass-produced electric vehicles.

Förderung

  • Central Government Guides Local Science and Technology Development Foundation of Guangxi Zhuang Autonomous Region
  • Guangxi Science and Technology Major Project

Zitieren

APA

Yang, R., You, Z., & Luo, R. (2025). MSFNet3D: Monocular 3D Object Detection via Dual-Branch Depth-Consistent Fusion and Semantic-Guided Point Cloud Refinement. World Electric Vehicle Journal, 16(3), 173. https://doi.org/10.3390/wevj16030173

Vancouver

Yang R, You Z, Luo R. MSFNet3D: Monocular 3D Object Detection via Dual-Branch Depth-Consistent Fusion and Semantic-Guided Point Cloud Refinement. World Electric Vehicle Journal. 2025;16(3):173. doi:10.3390/wevj16030173

BibTeX
@article{Yang2025,
  author = {Yang, Rong and You, Zhijie and Luo, Renhui},
  title = {MSFNet3D: Monocular 3D Object Detection via Dual-Branch Depth-Consistent Fusion and Semantic-Guided Point Cloud Refinement},
  journal = {World Electric Vehicle Journal},
  year = {2025},
  volume = {16},
  number = {3},
  pages = {173},
  doi = {10.3390/wevj16030173}
}
Kostenlos starten →