CL-fusionBEV: 3D object detection method with camera-LiDAR fusion in Bird’s Eye View
Complex & Intelligent Systems · 2024-12 · 10 (6) · 7681-7696
DOI: 10.1007/s40747-024-01567-0 ↗Kurz gefasst
Fachartikel in der Zeitschrift Complex & Intelligent Systems, online erschienen am 27.07.2024. Verfasst von Peicheng Shi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 61 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the Natural Science Foundation of Anhui Province, the Financial Support of the Key Research and Development Projects of Anhui.
Abstract (Originalsprache)
In the wave of research on autonomous driving, 3D object detection from the Bird’s Eye View (BEV) perspective has emerged as a pivotal area of focus. The essence of this challenge is the effective fusion of camera and LiDAR data into the BEV. Current approaches predominantly train and predict within the front view and Cartesian coordinate system, often overlooking the inherent structural and operational differences between cameras and LiDAR sensors. This paper introduces CL-FusionBEV, an innovative 3D object detection methodology tailored for sensor data fusion in the BEV perspective. Our approach initiates with a view transformation, facilitated by an implicit learning module that transitions the camera’s perspective to the BEV space, thereby aligning the prediction module. Subsequently, to achieve modal fusion within the BEV framework, we employ voxelization to convert the LiDAR point cloud into BEV space, thereby generating LiDAR BEV spatial features. Moreover, to integrate the BEV spatial features from both camera and LiDAR, we have developed a multi-modal cross-attention mechanism and an implicit multi-modal fusion network, designed to enhance the synergy and application of dual-modal data. To counteract potential deficiencies in global reasoning and feature interaction arising from multi-modal cross-attention, we propose a BEV self-attention mechanism that facilitates comprehensive global feature operations. Our methodology has undergone rigorous evaluation on a substantial dataset within the autonomous driving domain, the nuScenes dataset. The outcomes demonstrate that our method achieves a mean Average Precision (mAP) of 73.3% and a nuScenes Detection Score (NDS) of 75.5%, particularly excelling in the detection of cars and pedestrians with high accuracies of 89% and 90.7%, respectively. Additionally, CL-FusionBEV exhibits superior performance in identifying occluded and distant objects, surpassing existing comparative methods.
Förderung
- the Natural Science Foundation of Anhui Province
- the Financial Support of the Key Research and Development Projects of Anhui
Zitieren
APA
Shi, P., Liu, Z., Dong, X., & Yang, A. (2024). CL-fusionBEV: 3D object detection method with camera-LiDAR fusion in Bird’s Eye View. Complex & Intelligent Systems, 10(6), 7681-7696. https://doi.org/10.1007/s40747-024-01567-0
Vancouver
Shi P, Liu Z, Dong X, Yang A. CL-fusionBEV: 3D object detection method with camera-LiDAR fusion in Bird’s Eye View. Complex & Intelligent Systems. 2024;10(6):7681-7696. doi:10.1007/s40747-024-01567-0
BibTeX
@article{Shi2024,
author = {Shi, Peicheng and Liu, Zhiqiang and Dong, Xinlong and Yang, Aixi},
title = {CL-fusionBEV: 3D object detection method with camera-LiDAR fusion in Bird’s Eye View},
journal = {Complex & Intelligent Systems},
year = {2024},
volume = {10},
number = {6},
pages = {7681--7696},
doi = {10.1007/s40747-024-01567-0}
}
EUVIMED