ICFusion: Multimodal Image Fusion via Invertible Feature Enhancement and Cross-Modal Feature Balance
IEEE Sensors Journal · 15.07.2025 · 25 (14) · 27086-27100
DOI: 10.1109/jsen.2025.3575460 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Sensors Journal, erschienen am 15.07.2025. Verfasst von Xiaojiu Xu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 70 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Chinese Academy of Sciences, Young Scientists in Basic Research.
Abstract (Originalsprache)
Multimodal image fusion (MMIF) integrates information from multiple imaging modalities to produce images with comprehensive information and detailed textures. In recent years, deep learning-based MMIF methods have made significant advancements. However, existing methods frequently encounter high-frequency detail loss and insufficient texture representation, resulting in inadequate scene detail representation. Moreover, current image fusion methods lack sufficient interaction to balance complementary information, leading to the loss of modality-specific information in the fused results. To overcome these challenges, we propose an invertible feature enhancement and cross-modal information balance network called ICFusion, which aims to enhance texture details and strengthen the interaction between multimodal features. Specifically, we present the invertible Mamba module (IMM), which leverages an invertible structure for feature lossless transmission and extracts global multimodal features to inject long-range pixel dependencies, thereby enhancing the representation of high-frequency details in global information modeling. In addition, we introduce the cross-modal feature balance module (CFBM), which maps cross-modal features into space state models (SSMs) for interaction and adaptively fuses the interacted features with individual modality features to enhance the unique information of each modality, achieving the balance of complementary information across modalities. Extensive experiments on infrared-visible image fusion (IVF) and medical image fusion (MIF) tasks show that our proposed method yields remarkable results. Furthermore, we demonstrate that ICFusion can enhance the performance of downstream semantic segmentation in a unified benchmark.
Förderung
- National Natural Science Foundation of China
- Chinese Academy of Sciences
- Young Scientists in Basic Research
Zitieren
APA
Xu, X., Yang, G., Zhang, X., Zhang, J., Chen, X., & Liu, A. (2025). ICFusion: Multimodal Image Fusion via Invertible Feature Enhancement and Cross-Modal Feature Balance. IEEE Sensors Journal, 25(14), 27086-27100. https://doi.org/10.1109/jsen.2025.3575460
Vancouver
Xu X, Yang G, Zhang X, Zhang J, Chen X, Liu A. ICFusion: Multimodal Image Fusion via Invertible Feature Enhancement and Cross-Modal Feature Balance. IEEE Sensors Journal. 2025;25(14):27086-27100. doi:10.1109/jsen.2025.3575460
BibTeX
@article{Xu2025,
author = {Xu, Xiaojiu and Yang, Gang and Zhang, Xiaowen and Zhang, Jing and Chen, Xun and Liu, Aiping},
title = {ICFusion: Multimodal Image Fusion via Invertible Feature Enhancement and Cross-Modal Feature Balance},
journal = {IEEE Sensors Journal},
year = {2025},
volume = {25},
number = {14},
pages = {27086--27100},
doi = {10.1109/jsen.2025.3575460}
}
EUVIMED