Local-to-Global Semantic Learning for Multi-View 3D Object Detection From Point Cloud
IEEE Transactions on Circuits and Systems for Video Technology · 2024-10 · 34 (10) · 9371-9385
DOI: 10.1109/tcsvt.2024.3396870 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-10. Verfasst von Renzhong Qiao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 63 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
LiDAR, as an excellent sensor, can provide positions, motion states, and other objective attribute information of objects in the 3D world. Inevitably, the inherent sparsity of point cloud and the problem of occlusion tend to cause incomplete semantic and geometry information of long-range small objects, posing challenges to 3D object detection. The multi-view models take advantage of the complementary information among bird’s eye view (BEV), range view (RV), and other views to alleviate the above issues. However, most of the existing methods coarsely learn the views’ features and neglect the learning of semantic information, which further leads to unsatisfactory detection performance. To this end, this paper proposes a Local-to-Global Semantic Learning Network (LGSLNet) for multi-view 3D object detection from point cloud. The proposed LGSLNet can effectively learn semantic information to explore the local semantics contained in various channels of RV features and to fuse them with BEV features. It has two branches with different backbones. In the BEV branch, the voxels quantized from the point cloud are extracted by sparse convolutional networks and compressed to BEV features. In the RV branch, a multi-scale backbone with semantic-aware convolution (SAC) is designed to learn the local semantic information of the RV. It allows for adaptation to the 3D location using the auxiliary network. In the fusion module, the bidirectional cross-view channel attention (Bi-CCA) is designed to compensate for the semantic information between multiple views and aggregate new RV and BEV features. Extensive experiments on the KITTI, ONCE, and nuScenes 3D object detection datasets demonstrate the superiority of our proposed method.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Qiao, R., Ji, H., Zhu, Z., & Zhang, W. (2024). Local-to-Global Semantic Learning for Multi-View 3D Object Detection From Point Cloud. IEEE Transactions on Circuits and Systems for Video Technology, 34(10), 9371-9385. https://doi.org/10.1109/tcsvt.2024.3396870
Vancouver
Qiao R, Ji H, Zhu Z, Zhang W. Local-to-Global Semantic Learning for Multi-View 3D Object Detection From Point Cloud. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(10):9371-9385. doi:10.1109/tcsvt.2024.3396870
BibTeX
@article{Qiao2024,
author = {Qiao, Renzhong and Ji, Hongbing and Zhu, Zhigang and Zhang, Wenbo},
title = {Local-to-Global Semantic Learning for Multi-View 3D Object Detection From Point Cloud},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {10},
pages = {9371--9385},
doi = {10.1109/tcsvt.2024.3396870}
}
EUVIMED