MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception
Multimedia Systems · 2026-02 · 32 (1)
DOI: 10.1007/s00530-025-02080-1 ↗Kurz gefasst
Fachartikel in der Zeitschrift Multimedia Systems, online erschienen am 04.12.2025. Verfasst von Yu Zhang und 8 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Independent Research Project , Naval University of Engineering, PLA China, Jiangxi Provincial Natural Science Foundation of China.
Abstract (Originalsprache)
Visible and infrared image fusion (VIF) is essential for unmanned aerial vehicle (UAV) perception by integrating complementary information from heterogeneous sensors to enhance understanding in complex environments. Existing deep learning-based VIF methods often face a trade-off between the limited receptive fields of CNNs and the high computational overhead of Transformers. Although Mamba shows great potential in modeling long-range dependencies with linear complexity, it struggles to preserve spatial information in complex spatial correlations. Moreover, most VIF methods lack effective multimodal feature disentanglement, which is particularly challenging in low-light and cluttered backgrounds. To address these challenges, we propose MCDFuse, a novel Mamba-CNN-driven VIF framework that synergistically combines the strengths of Mamba and CNN architectures. We introduce a dynamic feature activation module to improve spatial modeling and facilitate high-quality image reconstruction. A dual-branch architecture integrates ConvNeXt modules to expand the receptive field and inverted residual blocks to enhance detail representation. Furthermore, a feature decomposition loss with normalization constraints is designed to optimize feature disentanglement during training. Comparative experiments on multiple datasets, including newly constructed ones, against 12 state-of-the-art methods demonstrate that our approach achieves superior fusion quality and improves performance on downstream object detection tasks. The dataset can be downloaded from https://github.com/MCDFuse/UAVScene.
Förderung
- Independent Research Project , Naval University of Engineering, PLA China
- Jiangxi Provincial Natural Science Foundation of China
Zitieren
APA
Zhang, Y., Cha, H., Zhang, H., Li, X., Chen, Z., Bai, J., Fu, T., Du, Y. C., & Zhang, X. (2026). MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception. Multimedia Systems, 32(1). https://doi.org/10.1007/s00530-025-02080-1
Vancouver
Zhang Y, Cha H, Zhang H, Li X, Chen Z, Bai J, et al. MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception. Multimedia Systems. 2026;32(1). doi:10.1007/s00530-025-02080-1
BibTeX
@article{Zhang2026,
author = {Zhang, Yu and Cha, Hao and Zhang, HanRui and Li, XiongHui and Chen, Zhuo and Bai, JiaMing and Fu, TingTing and Du, Yong Cheng and Zhang, Xian},
title = {MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception},
journal = {Multimedia Systems},
year = {2026},
volume = {32},
number = {1},
doi = {10.1007/s00530-025-02080-1}
}
EUVIMED