SACMFuse: Structure-Aware Cross-Modal Interaction Network for Multi-Modal Image Fusion
Mathematics · 21.08.2026 · 14 (16) · 3018
DOI: 10.3390/math14163018 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 21.08.2026. Verfasst von Quanrui Wen und 3 weiteren Autor:innen. Die Arbeit nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Humanities and Social Sciences Youth Foundation of Ministry of Education of China, Guangzhou Municipal Education Bureau, National Natural Science Foundation of China.
Abstract (Originalsprache)
Multi-modal image fusion integrates complementary information from different modalities to generate a unified representation that is informative for human perception and beneficial to downstream vision tasks. However, existing methods often inefficiently model global features and their cross-modal interaction is insufficient, resulting in the suboptimal preservation of structural details and modality-specific information. To address these issues, we propose SACMFuse, a structure-aware cross-modal interaction network for multi-modal image fusion. SACMFuse is built upon the linear complexity attention mechanism of LAMA, which enables efficient and effective global feature modeling. In this study, LAMA is extended into a CrossLAMA mechanism to facilitate deep-level information interaction among modalities. Within this framework, we propose a Frequency–Spatial Rectification Module (FSRM) that jointly models spatial-domain structures and frequency-domain representations in a unified manner. By perceiving and adaptively rectifying structural features across modalities, FSRM enhances the structural consistency and discriminability of the fused features. Furthermore, to strengthen cross-modal complementarity, we design a Difference-driven Cross-modal Interaction Module (DCIM), where inter-modal discrepancies explicitly guide information exchange among modalities. This mechanism encourages the network to focus on complementary structures while suppressing redundant responses. Extensive experiments on multiple datasets demonstrate that the performance of SACMFuse is competitive for the majority of metrics, providing a robust and advanced solution for image fusion tasks.
Förderung
- Humanities and Social Sciences Youth Foundation of Ministry of Education of China
- Guangzhou Municipal Education Bureau
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Guangdong Basic and Applied Basic Research Foundation
- Science and Technology Projects in Guangzhou
Zitieren
APA
Wen, Q., Shu, X., Zhang, X., & Yuan, D. (2026). SACMFuse: Structure-Aware Cross-Modal Interaction Network for Multi-Modal Image Fusion. Mathematics, 14(16), 3018. https://doi.org/10.3390/math14163018
Vancouver
Wen Q, Shu X, Zhang X, Yuan D. SACMFuse: Structure-Aware Cross-Modal Interaction Network for Multi-Modal Image Fusion. Mathematics. 2026;14(16):3018. doi:10.3390/math14163018
BibTeX
@article{Wen2026,
author = {Wen, Quanrui and Shu, Xiu and Zhang, Xinming and Yuan, Di},
title = {SACMFuse: Structure-Aware Cross-Modal Interaction Network for Multi-Modal Image Fusion},
journal = {Mathematics},
year = {2026},
volume = {14},
number = {16},
pages = {3018},
doi = {10.3390/math14163018}
}
EUVIMED