DepthFusion: Depth-Aware Hybrid Feature Fusion for LiDAR-Camera 3D Object Detection
IEEE Transactions on Multimedia · 2026 · 28 · 7217-7227
DOI: 10.1109/tmm.2026.3668596 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Multimedia, 2026. Verfasst von Mingqian Ji und 2 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 58 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Jiangsu Province, China.
Abstract (Originalsprache)
State-of-the-art LiDAR-camera 3D object detectors usually focus on feature fusion, but often neglect the role of depth in modulating the contribution of different modalities. In this work, we observe that the importance of each modality varies with depth through statistical analysis and visualization. Motivated by this finding, we propose a Depth-Aware Hybrid Feature Fusion (DepthFusion) strategy that explicitly encodes metric depth into the BEV feature space, guiding the fusion weights of point cloud and RGB image features at both global and local levels. Specifically, the Depth-GFusion module adaptively adjusts the weights of image BEV features in multi-modal global features via explicit depth encoding. Furthermore, to recover information lost when projecting raw features to BEV space, the Depth-LFusion module dynamically adjusts the weights of voxel and multi-view image features in local features based on depth. Extensive experiments on the nuScenes and KITTI datasets demonstrate that DepthFusion outperforms previous state-of-the-art methods. Moreover, DepthFusion shows superior robustness to various corruptions on the nuScenes-C dataset.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Jiangsu Province, China
Zitieren
APA
Ji, M., Yang, J., & Zhang, S. (2026). DepthFusion: Depth-Aware Hybrid Feature Fusion for LiDAR-Camera 3D Object Detection. IEEE Transactions on Multimedia, 28, 7217-7227. https://doi.org/10.1109/tmm.2026.3668596
Vancouver
Ji M, Yang J, Zhang S. DepthFusion: Depth-Aware Hybrid Feature Fusion for LiDAR-Camera 3D Object Detection. IEEE Transactions on Multimedia. 2026;28:7217-7227. doi:10.1109/tmm.2026.3668596
BibTeX
@article{Ji2026,
author = {Ji, Mingqian and Yang, Jian and Zhang, Shanshan},
title = {DepthFusion: Depth-Aware Hybrid Feature Fusion for LiDAR-Camera 3D Object Detection},
journal = {IEEE Transactions on Multimedia},
year = {2026},
volume = {28},
pages = {7217--7227},
doi = {10.1109/tmm.2026.3668596}
}
EUVIMED