EUVIMEDEUVIMED entdecken
Crossref

DBCNet: Dynamic Bilateral Cross-Fusion Network for RGB-T Urban Scene Understanding in Intelligent Vehicles

Wujie Zhou, Tingting Gong, Jingsheng Lei, Lu Yu

IEEE Transactions on Systems, Man, and Cybernetics: Systems · 2023-12 · 53 (12) · 7631-7641

DOI: 10.1109/tsmc.2023.3298921 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2023-12. Verfasst von Wujie Zhou und 3 weiteren Autor:innen. Die Arbeit wurde bisher 69-mal zitiert (Crossref) und nennt 63 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Understanding urban scenes is a fundamental capability required of intelligent vehicles. Depth cues provide useful geometric information for semantic segmentation, thus complementing RGB (color) data. Although single-modal RGB images are improved by depth information, semantic segmentation may be degraded in poor-visibility conditions. Thermal imaging can address some limitations of depth data. Therefore, we leverage the multimodal information in RGB-and-thermal (RGB-T) images by introducing a dynamic bilateral cross-fusion network (DBCNet) for RGB-T urban scene understanding. First, RGB-T features extracted by a given backbone are regrouped as high- or low-level features. Second, multimodal high-level features are sent to a dynamic bilateral cross-fusion module for further refinement. Third, a bounded high-level semantic-feature integration module is added to provide feature guidance, and a multitask supervision mechanism is used for fine-tuning. Extensive experiments on two RGB-T urban scene-understanding datasets indicate that DBCNet aggregates multilevel deep features effectively and outperforms state-of-the-art deep-learning scene-understanding methods.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Zhou, W., Gong, T., Lei, J., & Yu, L. (2023). DBCNet: Dynamic Bilateral Cross-Fusion Network for RGB-T Urban Scene Understanding in Intelligent Vehicles. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 53(12), 7631-7641. https://doi.org/10.1109/tsmc.2023.3298921

Vancouver

Zhou W, Gong T, Lei J, Yu L. DBCNet: Dynamic Bilateral Cross-Fusion Network for RGB-T Urban Scene Understanding in Intelligent Vehicles. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2023;53(12):7631-7641. doi:10.1109/tsmc.2023.3298921

BibTeX
@article{Zhou2023,
  author = {Zhou, Wujie and Gong, Tingting and Lei, Jingsheng and Yu, Lu},
  title = {DBCNet: Dynamic Bilateral Cross-Fusion Network for RGB-T Urban Scene Understanding in Intelligent Vehicles},
  journal = {IEEE Transactions on Systems, Man, and Cybernetics: Systems},
  year = {2023},
  volume = {53},
  number = {12},
  pages = {7631--7641},
  doi = {10.1109/tsmc.2023.3298921}
}
Kostenlos starten →