EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception

Yu Zhang, Hao Cha, HanRui Zhang, XiongHui Li, Zhuo Chen, JiaMing Bai, TingTing Fu, Yong Cheng Du, Xian Zhang

Multimedia Systems · 2026-02 · 32 (1)

DOI: 10.1007/s00530-025-02080-1 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Multimedia Systems, online erschienen am 04.12.2025. Verfasst von Yu Zhang und 8 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Independent Research Project , Naval University of Engineering, PLA China, Jiangxi Provincial Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visible and infrared image fusion (VIF) is essential for unmanned aerial vehicle (UAV) perception by integrating complementary information from heterogeneous sensors to enhance understanding in complex environments. Existing deep learning-based VIF methods often face a trade-off between the limited receptive fields of CNNs and the high computational overhead of Transformers. Although Mamba shows great potential in modeling long-range dependencies with linear complexity, it struggles to preserve spatial information in complex spatial correlations. Moreover, most VIF methods lack effective multimodal feature disentanglement, which is particularly challenging in low-light and cluttered backgrounds. To address these challenges, we propose MCDFuse, a novel Mamba-CNN-driven VIF framework that synergistically combines the strengths of Mamba and CNN architectures. We introduce a dynamic feature activation module to improve spatial modeling and facilitate high-quality image reconstruction. A dual-branch architecture integrates ConvNeXt modules to expand the receptive field and inverted residual blocks to enhance detail representation. Furthermore, a feature decomposition loss with normalization constraints is designed to optimize feature disentanglement during training. Comparative experiments on multiple datasets, including newly constructed ones, against 12 state-of-the-art methods demonstrate that our approach achieves superior fusion quality and improves performance on downstream object detection tasks. The dataset can be downloaded from https://github.com/MCDFuse/UAVScene.

Förderung

  • Independent Research Project , Naval University of Engineering, PLA China
  • Jiangxi Provincial Natural Science Foundation of China

Zitieren

APA

Zhang, Y., Cha, H., Zhang, H., Li, X., Chen, Z., Bai, J., Fu, T., Du, Y. C., & Zhang, X. (2026). MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception. Multimedia Systems, 32(1). https://doi.org/10.1007/s00530-025-02080-1

Vancouver

Zhang Y, Cha H, Zhang H, Li X, Chen Z, Bai J, et al. MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception. Multimedia Systems. 2026;32(1). doi:10.1007/s00530-025-02080-1

BibTeX
@article{Zhang2026,
  author = {Zhang, Yu and Cha, Hao and Zhang, HanRui and Li, XiongHui and Chen, Zhuo and Bai, JiaMing and Fu, TingTing and Du, Yong Cheng and Zhang, Xian},
  title = {MCDFus: visible and infrared image fusion via Mamba-CNN for enhanced UAV perception},
  journal = {Multimedia Systems},
  year = {2026},
  volume = {32},
  number = {1},
  doi = {10.1007/s00530-025-02080-1}
}
Kostenlos starten →