CFMW: Cross-Modality Fusion Mamba for Robust Object Detection Under Adverse Weather
IEEE Transactions on Circuits and Systems for Video Technology · 2025-12 · 35 (12) · 12066-12081
DOI: 10.1109/tcsvt.2025.3587918 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-12. Verfasst von Haoyuan Li und 6 weiteren Autor:innen. Die Arbeit wurde bisher 39-mal zitiert (Crossref) und nennt 92 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Hunan Provincial Research and Development Project, Zhejiang Provincial Natural Science Foundation of China.
Abstract (Originalsprache)
Visible-infrared image pairs provide complementary information, enhancing the reliability and robustness of object detection applications in real-world scenarios. However, most existing methods face challenges in maintaining robustness under complex weather conditions, which limits their applicability. Meanwhile, the reliance on attention mechanisms in modality fusion introduces significant computational complexity and storage overhead, particularly when dealing with high-resolution images. To address these challenges, we propose the Cross-modality Fusion Mamba with Weather-removal (CFMW) to augment stability and cost-effectiveness under adverse weather conditions. Leveraging the proposed Perturbation-Adaptive Diffusion Model (PADM) and Cross-modality Fusion Mamba (CFM) modules, CFMW is able to reconstruct visual features affected by adverse weather, enriching the representation of image details. With efficient architecture design, CFMW is 3 times faster than Transformer-style fusion (e.g., CFT). To bridge the gap in relevant datasets, we construct a new Severe Weather Visible-Infrared (SWVI) dataset, encompassing diverse adverse weather scenarios such as rain, haze, and snow. The dataset contains $64,281$ paired visible-infrared images, providing a valuable resource for future research. Extensive experiments on public datasets (i.e., M3FD and LLVIP) and the newly constructed SWVI dataset conclusively demonstrate that CFMW achieves state-of-the-art detection performance. Both the dataset and source code will be made publicly available at https://github.com/lhy-zjut/CFMW
Förderung
- National Natural Science Foundation of China
- Hunan Provincial Research and Development Project
- Zhejiang Provincial Natural Science Foundation of China
- Open Research Project of the State Key Laboratory of Industrial Control Technology
Zitieren
APA
Li, H., Hu, Q., Zhou, B., Yao, Y., Lin, J., Yang, K., & Chen, P. (2025). CFMW: Cross-Modality Fusion Mamba for Robust Object Detection Under Adverse Weather. IEEE Transactions on Circuits and Systems for Video Technology, 35(12), 12066-12081. https://doi.org/10.1109/tcsvt.2025.3587918
Vancouver
Li H, Hu Q, Zhou B, Yao Y, Lin J, Yang K, et al. CFMW: Cross-Modality Fusion Mamba for Robust Object Detection Under Adverse Weather. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(12):12066-12081. doi:10.1109/tcsvt.2025.3587918
BibTeX
@article{Li2025,
author = {Li, Haoyuan and Hu, Qi and Zhou, Binjia and Yao, You and Lin, Jiacheng and Yang, Kailun and Chen, Peng},
title = {CFMW: Cross-Modality Fusion Mamba for Robust Object Detection Under Adverse Weather},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2025},
volume = {35},
number = {12},
pages = {12066--12081},
doi = {10.1109/tcsvt.2025.3587918}
}
EUVIMED