DBCNet: Dynamic Bilateral Cross-Fusion Network for RGB-T Urban Scene Understanding in Intelligent Vehicles
IEEE Transactions on Systems, Man, and Cybernetics: Systems · 2023-12 · 53 (12) · 7631-7641
DOI: 10.1109/tsmc.2023.3298921 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023-12. Verfasst von Wujie Zhou und 3 weiteren Autor:innen. Die Arbeit wurde bisher 69-mal zitiert (Crossref) und nennt 63 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.
Abstract (Originalsprache)
Understanding urban scenes is a fundamental capability required of intelligent vehicles. Depth cues provide useful geometric information for semantic segmentation, thus complementing RGB (color) data. Although single-modal RGB images are improved by depth information, semantic segmentation may be degraded in poor-visibility conditions. Thermal imaging can address some limitations of depth data. Therefore, we leverage the multimodal information in RGB-and-thermal (RGB-T) images by introducing a dynamic bilateral cross-fusion network (DBCNet) for RGB-T urban scene understanding. First, RGB-T features extracted by a given backbone are regrouped as high- or low-level features. Second, multimodal high-level features are sent to a dynamic bilateral cross-fusion module for further refinement. Third, a bounded high-level semantic-feature integration module is added to provide feature guidance, and a multitask supervision mechanism is used for fine-tuning. Extensive experiments on two RGB-T urban scene-understanding datasets indicate that DBCNet aggregates multilevel deep features effectively and outperforms state-of-the-art deep-learning scene-understanding methods.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
Zitieren
APA
Zhou, W., Gong, T., Lei, J., & Yu, L. (2023). DBCNet: Dynamic Bilateral Cross-Fusion Network for RGB-T Urban Scene Understanding in Intelligent Vehicles. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 53(12), 7631-7641. https://doi.org/10.1109/tsmc.2023.3298921
Vancouver
Zhou W, Gong T, Lei J, Yu L. DBCNet: Dynamic Bilateral Cross-Fusion Network for RGB-T Urban Scene Understanding in Intelligent Vehicles. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2023;53(12):7631-7641. doi:10.1109/tsmc.2023.3298921
BibTeX
@article{Zhou2023,
author = {Zhou, Wujie and Gong, Tingting and Lei, Jingsheng and Yu, Lu},
title = {DBCNet: Dynamic Bilateral Cross-Fusion Network for RGB-T Urban Scene Understanding in Intelligent Vehicles},
journal = {IEEE Transactions on Systems, Man, and Cybernetics: Systems},
year = {2023},
volume = {53},
number = {12},
pages = {7631--7641},
doi = {10.1109/tsmc.2023.3298921}
}
EUVIMED