Multi‐Attention Guided Feature Collaborate Network for RGB‐D Semantic Segmentation
IET Image Processing · 2026-01 · 20 (1)
DOI: 10.1049/ipr2.70422 ↗At a glance
Journal article in IET Image Processing, published online on 2026-07-01. Written by Junhao Song and 5 co-authors. 56 references. The full text is freely available (open access, CC BY-NC-ND 4.0). Funded by: Natural Science Foundation of Beijing Municipality.
Abstract (original language)
Indoor RGB‐D semantic segmentation benefits from depth information for enhanced scene understanding, yet faces challenges including modality discrepancies, noise interference and loss of fine‐grained details during feature extraction. Although cross‐modal fusion for RGB‐X semantic segmentation (CMX) enables deep cross‐modal correction and fusion, it remains limited in noise suppression, detailed feature handling, and multiscale feature utilization. To address these limitations, we propose the multi‐attention guided feature collaborate network (MAGFCNet), an attention‐based feature coordination network built upon CMX. MAGFCNet introduces a three‐stage feature calibration module (FCM), where the first two stages perform progressive calibration through channel‐wise calibration followed by channel‐spatial joint calibration to suppress modality‐specific noise, followed by a dynamic fusion stage for cross‐modal feature integration. A feature aggregation module (FAM) then combines efficient cross‐attention for global information exchange with a contextual feature fusion module (CFFM) for spatial‐domain adaptive fusion, where CFFM leverages a global–local feature fusion module (G‐LFFM), a lightweight yet effective design inspired by existing attention mechanisms, to balance global context and local details through parallel branches. Furthermore, a top‐down decoder employs CFFM with dual‐path enhancement to progressively integrate multiscale features while recovering structural boundaries. Extensive experiments on NYU Depth v2 and SUN‐RGBD demonstrate that MAGFCNet achieves consistent improvements over CMX across multiple settings. With a MiT‐B5 backbone, MAGFCNet achieves measurable improvements of 0.19% mIoU and 0.23% PA on NYU Depth v2, and with a MiT‐B2 backbone, it improves mIoU by 0.45% on SUN‐RGBD. Qualitative results further show that MAGFCNet provides more robust performance in reflective, occluded and structurally ambiguous regions, demonstrating enhanced boundary preservation and improved contextual reasoning.
Funding
- Natural Science Foundation of Beijing Municipality
Cite
APA
Song, J., Du, C., Wang, C., Li, H., Liu, R., & Qi, Y. (2026). Multi‐Attention Guided Feature Collaborate Network for RGB‐D Semantic Segmentation. IET Image Processing, 20(1). https://doi.org/10.1049/ipr2.70422
Vancouver
Song J, Du C, Wang C, Li H, Liu R, Qi Y. Multi‐Attention Guided Feature Collaborate Network for RGB‐D Semantic Segmentation. IET Image Processing. 2026;20(1). doi:10.1049/ipr2.70422
BibTeX
@article{Song2026,
author = {Song, Junhao and Du, Chenxi and Wang, Chen and Li, Haisheng and Liu, Ruijun and Qi, Yue},
title = {Multi‐Attention Guided Feature Collaborate Network for RGB‐D Semantic Segmentation},
journal = {IET Image Processing},
year = {2026},
volume = {20},
number = {1},
doi = {10.1049/ipr2.70422}
}
EUVIMED