EGFNet: Edge-Aware Guidance Fusion Network for RGB–Thermal Urban Scene Parsing
IEEE Transactions on Intelligent Transportation Systems · 2024-01 · 25 (1) · 657-669
DOI: 10.1109/tits.2023.3306368 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2024-01. Verfasst von Shaohua Dong und 3 weiteren Autor:innen. Die Arbeit wurde bisher 100-mal zitiert (Crossref) und nennt 93 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.
Abstract (Originalsprache)
Urban scene parsing is the core of the intelligent transportation system, and RGB–thermal urban scene parsing has recently attracted increasing research interest in the field of computer vision. However, most existing approaches fail to perform good boundary extraction for prediction maps and cannot fully use high-level features. In addition, these methods simply fuse the features from RGB and thermal modalities but are unable to obtain comprehensive fused features. To address these problems, an edge-aware guidance fusion network (EGFNet) was developed in this study for RGB–thermal urban scene parsing. First, a prior edge map generated using the RGB and thermal images were introduced to capture detailed information in the prediction map and then embed the prior edge cues into the feature maps. To fuse the RGB and thermal information effectively, a multimodal fusion module was designed that guarantees adequate cross-modal fusion. Considering the importance of high-level semantic information, global and semantic information modules were proposed to extract rich semantic information from the high-level features. For decoding, simple elementwise addition was utilized for cascaded feature fusion. Finally, to improve the parsing accuracy, multitask deep supervision was applied to the semantic and boundary maps. Extensive experiments were performed on benchmark datasets to demonstrate the effectiveness of the proposed EGFNet and its superior performance compared with the state-of-the-art methods.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
Zitieren
APA
Dong, S., Zhou, W., Xu, C., & Yan, W. (2024). EGFNet: Edge-Aware Guidance Fusion Network for RGB–Thermal Urban Scene Parsing. IEEE Transactions on Intelligent Transportation Systems, 25(1), 657-669. https://doi.org/10.1109/tits.2023.3306368
Vancouver
Dong S, Zhou W, Xu C, Yan W. EGFNet: Edge-Aware Guidance Fusion Network for RGB–Thermal Urban Scene Parsing. IEEE Transactions on Intelligent Transportation Systems. 2024;25(1):657-669. doi:10.1109/tits.2023.3306368
BibTeX
@article{Dong2024,
author = {Dong, Shaohua and Zhou, Wujie and Xu, Caie and Yan, Weiqing},
title = {EGFNet: Edge-Aware Guidance Fusion Network for RGB–Thermal Urban Scene Parsing},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2024},
volume = {25},
number = {1},
pages = {657--669},
doi = {10.1109/tits.2023.3306368}
}
EUVIMED