MiLNet: Multiplex Interactive Learning Network for RGB-T Semantic Segmentation
IEEE Transactions on Image Processing · 2025 · 34 · 1686-1699
DOI: 10.1109/tip.2025.3544484 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2025. Verfasst von Jinfu Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 71 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology.
Abstract (Originalsprache)
Semantic segmentation methods enhance robust and reliable understanding under adverse illumination conditions by integrating complementary information from visible and thermal infrared (RGB-T) images. Existing methods primarily focus on designing various feature fusion modules between different modalities, overlooking that feature learning is the critical aspect of scene understanding. In this paper, we propose a novel module-free Multiplex Interactive Learning Network (MiLNet) for RGB-T semantic segmentation, which adeptly integrates multi-model, multi-modal, and multi-level feature learning, fully exploiting the potential of multiplex feature interaction. Specifically, robust knowledge is transferred from the vision foundation model to our task-specific model to enhance its segmentation performance. In the task-specific model, an asymmetric simulated learning strategy is introduced to facilitate mutual learning of geometric and semantic information between high- and low-level features across modalities. Additionally, an inverse hierarchical fusion strategy based on feature learning pairs is adopted and further refined using multilabel and multiscale supervision. Experimental results on the MFNet and PST900 datasets demonstrate that MiLNet outperforms state-of-the-art methods in terms of mIoU. As a limitation, the model's performance under few-sample conditions could be improved further. The code and results of our method are available at https://github.com/Jinfu-pku/MiLNet.
Förderung
- National Natural Science Foundation of China
- Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology
Zitieren
APA
Liu, J., Liu, H., Li, X., Ren, J., & Xu, X. (2025). MiLNet: Multiplex Interactive Learning Network for RGB-T Semantic Segmentation. IEEE Transactions on Image Processing, 34, 1686-1699. https://doi.org/10.1109/tip.2025.3544484
Vancouver
Liu J, Liu H, Li X, Ren J, Xu X. MiLNet: Multiplex Interactive Learning Network for RGB-T Semantic Segmentation. IEEE Transactions on Image Processing. 2025;34:1686-1699. doi:10.1109/tip.2025.3544484
BibTeX
@article{Liu2025,
author = {Liu, Jinfu and Liu, Hong and Li, Xia and Ren, Jiale and Xu, Xinhua},
title = {MiLNet: Multiplex Interactive Learning Network for RGB-T Semantic Segmentation},
journal = {IEEE Transactions on Image Processing},
year = {2025},
volume = {34},
pages = {1686--1699},
doi = {10.1109/tip.2025.3544484}
}
EUVIMED