EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Towards Robust Multimodal Detection via Progressive Cross‐Domain Feature Fusion

Yaqiong Wang, Yipei Wang, Baoguo Shen, Zhaohui Dang, Zhenhua Hou

IET Computer Vision · 2026-01 · 20 (1)

DOI: 10.1049/cvi2.70074 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Computer Vision, online erschienen am 28.06.2026. Verfasst von Yaqiong Wang und 4 weiteren Autor:innen. Die Arbeit nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal object detection with RGB and thermal infrared imagery is essential for reliable perception in complex environments, but existing methods often remain limited by insufficient cross‐modal feature fusion. To address this issue, we propose PFDet, a progressive cross‐domain feature fusion framework for robust multimodal detection. PFDet progressively aligns semantic cues, interacts cross‐modal features, and refines multi‐scale representations. Specifically, a Semantic Alignment Guidance (SAG) module establishes a unified semantic reference at the input level to guide subsequent fusion. Unified Cross‐Modal Fusion Modules (UCMF) are then deployed across the backbone to enable fine‐grained bidirectional feature interaction, while a Context Guide Fusion Module (CGFM) performs context‐aware multi‐scale refinement in the neck network. Experimental results on the M3FD and FLIR‐Aligned datasets show that PFDet achieves state‐of‐the‐art performance, reaching 86.7% mAP@0.5 on M3FD and 86.9% mAP@0.5 on FLIR‐Aligned, while maintaining real‐time inference speed. Ablation studies further validate the effectiveness of the proposed progressive fusion strategy. This work provides a robust and scalable paradigm for multimodal object detection, with the potential to be extended to other heterogeneous sensing modalities, contributing to reliable perception in complex real‐world environments.

Zitieren

APA

Wang, Y., Wang, Y., Shen, B., Dang, Z., & Hou, Z. (2026). Towards Robust Multimodal Detection via Progressive Cross‐Domain Feature Fusion. IET Computer Vision, 20(1). https://doi.org/10.1049/cvi2.70074

Vancouver

Wang Y, Wang Y, Shen B, Dang Z, Hou Z. Towards Robust Multimodal Detection via Progressive Cross‐Domain Feature Fusion. IET Computer Vision. 2026;20(1). doi:10.1049/cvi2.70074

BibTeX
@article{Wang2026,
  author = {Wang, Yaqiong and Wang, Yipei and Shen, Baoguo and Dang, Zhaohui and Hou, Zhenhua},
  title = {Towards Robust Multimodal Detection via Progressive Cross‐Domain Feature Fusion},
  journal = {IET Computer Vision},
  year = {2026},
  volume = {20},
  number = {1},
  doi = {10.1049/cvi2.70074}
}
Kostenlos starten →