Towards Robust Multimodal Detection via Progressive Cross‐Domain Feature Fusion
IET Computer Vision · 2026-01 · 20 (1)
DOI: 10.1049/cvi2.70074 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Computer Vision, online erschienen am 28.06.2026. Verfasst von Yaqiong Wang und 4 weiteren Autor:innen. Die Arbeit nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Multimodal object detection with RGB and thermal infrared imagery is essential for reliable perception in complex environments, but existing methods often remain limited by insufficient cross‐modal feature fusion. To address this issue, we propose PFDet, a progressive cross‐domain feature fusion framework for robust multimodal detection. PFDet progressively aligns semantic cues, interacts cross‐modal features, and refines multi‐scale representations. Specifically, a Semantic Alignment Guidance (SAG) module establishes a unified semantic reference at the input level to guide subsequent fusion. Unified Cross‐Modal Fusion Modules (UCMF) are then deployed across the backbone to enable fine‐grained bidirectional feature interaction, while a Context Guide Fusion Module (CGFM) performs context‐aware multi‐scale refinement in the neck network. Experimental results on the M3FD and FLIR‐Aligned datasets show that PFDet achieves state‐of‐the‐art performance, reaching 86.7% mAP@0.5 on M3FD and 86.9% mAP@0.5 on FLIR‐Aligned, while maintaining real‐time inference speed. Ablation studies further validate the effectiveness of the proposed progressive fusion strategy. This work provides a robust and scalable paradigm for multimodal object detection, with the potential to be extended to other heterogeneous sensing modalities, contributing to reliable perception in complex real‐world environments.
Zitieren
APA
Wang, Y., Wang, Y., Shen, B., Dang, Z., & Hou, Z. (2026). Towards Robust Multimodal Detection via Progressive Cross‐Domain Feature Fusion. IET Computer Vision, 20(1). https://doi.org/10.1049/cvi2.70074
Vancouver
Wang Y, Wang Y, Shen B, Dang Z, Hou Z. Towards Robust Multimodal Detection via Progressive Cross‐Domain Feature Fusion. IET Computer Vision. 2026;20(1). doi:10.1049/cvi2.70074
BibTeX
@article{Wang2026,
author = {Wang, Yaqiong and Wang, Yipei and Shen, Baoguo and Dang, Zhaohui and Hou, Zhenhua},
title = {Towards Robust Multimodal Detection via Progressive Cross‐Domain Feature Fusion},
journal = {IET Computer Vision},
year = {2026},
volume = {20},
number = {1},
doi = {10.1049/cvi2.70074}
}
EUVIMED