AGFNet: Adaptive Gated Fusion Network for RGB-T Semantic Segmentation
IEEE Transactions on Intelligent Transportation Systems · 2025-05 · 26 (5) · 6477-6492
DOI: 10.1109/tits.2025.3528064 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-05. Verfasst von Xiaofei Zhou und 5 weiteren Autor:innen. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 91 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, Natural Science Foundation of Zhejiang.
Abstract (Originalsprache)
RGB-T semantic segmentation can effectively pop-out objects from challenging scenarios (e.g., low illumination and low contrast environments) by combining RGB and thermal infrared images. However, the existing cutting-edge RGB-T semantic segmentation methods often present insufficient exploration of multi-modal feature fusion, where they overlook the differences between the two modalities. In this paper, we propose an adaptive gated fusion network (AGFNet) to conduct RGB-T semantic segmentation, where the multi-modal features are combined via the gating mechanisms and the spatial details are enhanced via the introduction of edge information. Specifically, the AGFNet employs a cross-modal adaptive gated-attention fusion (CAGF) module to aggregate the RGB and thermal features, where we give a sufficient exploration of the complementarity between the two-modal features via the gated attention unit (GAU). Particularly, in GAU, the gates can be used to purify the features, and the channel and spatial attention mechanisms are further employed to enhance the two-modal features interactively. Then, we design an edge detection (ED) module to learn the object-related edge cues, which simultaneously incorporates local detail information from low-level features and global location information from high-level features. After that, we deploy the edge guidance (EG) module to emphasize the spatial details of the fused features. Next, we deploy the contextual elevation (CE) module to enrich the contextual information of features by iteratively introducing the sine and cosine functions. Finally, considering that the quality of thermal images is usually lower than that of RGB images, we progressively integrate the multi-level RGB encoder features with multi-level decoder features, thereby focusing more on appearance information. Following this way, we can acquire the final high-quality segmentation result. Extensive experiments are performed on three public datasets including MFNet, PST900 and FMB datasets, and the experimental results show that our method achieves competitive performance when compared with the 22 state-of-the-art methods.
Förderung
- National Natural Science Foundation of China
- National Key Research and Development Program of China
- Natural Science Foundation of Zhejiang
- Key Research and Development Program of Zhejiang
- Natural Science Foundation of Zhejiang Province
- Natural Science Foundation of Ningbo
Zitieren
APA
Zhou, X., Wu, X., Bao, L., Yin, H., Jiang, Q., & Zhang, J. (2025). AGFNet: Adaptive Gated Fusion Network for RGB-T Semantic Segmentation. IEEE Transactions on Intelligent Transportation Systems, 26(5), 6477-6492. https://doi.org/10.1109/tits.2025.3528064
Vancouver
Zhou X, Wu X, Bao L, Yin H, Jiang Q, Zhang J. AGFNet: Adaptive Gated Fusion Network for RGB-T Semantic Segmentation. IEEE Transactions on Intelligent Transportation Systems. 2025;26(5):6477-6492. doi:10.1109/tits.2025.3528064
BibTeX
@article{Zhou2025,
author = {Zhou, Xiaofei and Wu, Xiaoling and Bao, Liuxin and Yin, Haibing and Jiang, Qiuping and Zhang, Jiyong},
title = {AGFNet: Adaptive Gated Fusion Network for RGB-T Semantic Segmentation},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2025},
volume = {26},
number = {5},
pages = {6477--6492},
doi = {10.1109/tits.2025.3528064}
}
EUVIMED