EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Dual-Branch Lightweight Network for Multimodal Image Fusion with Mamba and INN

Nan Li, Hongxin Li, Lin Tian

Sensors · 15.06.2026 · 26 (12) · 3814

DOI: 10.3390/s26123814 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 15.06.2026. Verfasst von Nan Li und 2 weiteren Autor:innen. Beteiligte Einrichtung: Xinjiang Laboratory of Phase Transitions and Microstructures in Condensed Matter Physics, Yili Normal University, Yining 835000, China. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Yili Normal University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal image fusion aims to integrate complementary information from heterogeneous imaging modalities into a single informative image. However, many deep learning-based fusion methods rely on complex feature extractors, leading to high computational cost and limited suitability for real-time deployment on resource-constrained devices. To address this issue, this paper proposes a lightweight Mamba-INN dual-branch network for efficient multimodal image fusion. The proposed model decouples global structure modeling from local detail preservation. A simplified Mamba-inspired branch is designed to capture long-range contextual dependencies, while a lightweight invertible neural network branch preserves high-frequency textures and edge information through information-preserving transformations. The lightweight INN branch preserves high-frequency texture and edge information during the forward feature transformation process through reversible feature partitioning, coupled transformations, and exponential scale modulation, thereby reducing the loss of detail caused by feature compression. Compact shallow feature refinement, module reuse, low-dimensional channel design, and a streamlined decoder are further introduced to reduce redundant computation. Experiments on infrared-visible and medical image fusion benchmarks, including MSRS, TNO, RoadScene, MRI-CT, MRI-PET, and MRI-SPECT datasets, demonstrate that the proposed method achieves competitive fusion quality with low model complexity. The proposed method achieves performance comparable to or better than that of methods such as CDDFuse, U2Fusion, CNN and SDNet on metrics including MI, VIF, Qabf, and SSIM for infrared-visible and medical image fusion tasks, while containing only 0.24 million parameters and requiring 24.04 GFLOPs of computational power at an input resolution of 256 × 256. Compared to CDDFuse, our method significantly reduces model complexity, enhancing the potential for lightweight deployment while maintaining fusion quality.

Schlagwörter

Stichwörter der Autor:innen

Mambainfrared-visible image fusioninvertible neural networklightweight networkmedical image fusionmultimodal image fusion

Autor:innen und Institutionen

  • Xinjiang Laboratory of Phase Transitions and Microstructures in Condensed Matter Physics, Yili Normal University, Yining 835000, China.
  • School of Electronic Engineering, Yili Normal University, Yining 835000, China.

Förderung

  • Yili Normal University

Zitieren

APA

Li, N., Li, H., & Tian, L. (2026). A Dual-Branch Lightweight Network for Multimodal Image Fusion with Mamba and INN. Sensors, 26(12), 3814. https://doi.org/10.3390/s26123814

Vancouver

Li N, Li H, Tian L. A Dual-Branch Lightweight Network for Multimodal Image Fusion with Mamba and INN. Sensors. 2026;26(12):3814. doi:10.3390/s26123814

BibTeX
@article{Li2026,
  author = {Li, Nan and Li, Hongxin and Tian, Lin},
  title = {A Dual-Branch Lightweight Network for Multimodal Image Fusion with Mamba and INN},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {12},
  pages = {3814},
  doi = {10.3390/s26123814}
}
Kostenlos starten →