EUVIMEDEUVIMED entdecken
Crossref

MiLNet: Multiplex Interactive Learning Network for RGB-T Semantic Segmentation

Jinfu Liu, Hong Liu, Xia Li, Jiale Ren, Xinhua Xu

IEEE Transactions on Image Processing · 2025 · 34 · 1686-1699

DOI: 10.1109/tip.2025.3544484 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2025. Verfasst von Jinfu Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 71 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Semantic segmentation methods enhance robust and reliable understanding under adverse illumination conditions by integrating complementary information from visible and thermal infrared (RGB-T) images. Existing methods primarily focus on designing various feature fusion modules between different modalities, overlooking that feature learning is the critical aspect of scene understanding. In this paper, we propose a novel module-free Multiplex Interactive Learning Network (MiLNet) for RGB-T semantic segmentation, which adeptly integrates multi-model, multi-modal, and multi-level feature learning, fully exploiting the potential of multiplex feature interaction. Specifically, robust knowledge is transferred from the vision foundation model to our task-specific model to enhance its segmentation performance. In the task-specific model, an asymmetric simulated learning strategy is introduced to facilitate mutual learning of geometric and semantic information between high- and low-level features across modalities. Additionally, an inverse hierarchical fusion strategy based on feature learning pairs is adopted and further refined using multilabel and multiscale supervision. Experimental results on the MFNet and PST900 datasets demonstrate that MiLNet outperforms state-of-the-art methods in terms of mIoU. As a limitation, the model's performance under few-sample conditions could be improved further. The code and results of our method are available at https://github.com/Jinfu-pku/MiLNet.

Förderung

  • National Natural Science Foundation of China
  • Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology

Zitieren

APA

Liu, J., Liu, H., Li, X., Ren, J., & Xu, X. (2025). MiLNet: Multiplex Interactive Learning Network for RGB-T Semantic Segmentation. IEEE Transactions on Image Processing, 34, 1686-1699. https://doi.org/10.1109/tip.2025.3544484

Vancouver

Liu J, Liu H, Li X, Ren J, Xu X. MiLNet: Multiplex Interactive Learning Network for RGB-T Semantic Segmentation. IEEE Transactions on Image Processing. 2025;34:1686-1699. doi:10.1109/tip.2025.3544484

BibTeX
@article{Liu2025,
  author = {Liu, Jinfu and Liu, Hong and Li, Xia and Ren, Jiale and Xu, Xinhua},
  title = {MiLNet: Multiplex Interactive Learning Network for RGB-T Semantic Segmentation},
  journal = {IEEE Transactions on Image Processing},
  year = {2025},
  volume = {34},
  pages = {1686--1699},
  doi = {10.1109/tip.2025.3544484}
}
Kostenlos starten →