Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving
Electronics · 30.03.2026 · 15 (7) · 1427
DOI: 10.3390/electronics15071427 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 30.03.2026. Verfasst von Long Xiao und 2 weiteren Autor:innen. Die Arbeit nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Beijing Institute of Technology https://ror.org/01skt4w74.
Abstract (Originalsprache)
Infrared and visible image fusion is a critical technology for enhancing the all-weather perception capabilities of autonomous driving systems. However, the inherent physical parallax of vehicle-mounted sensors combined with motion-induced vibrations makes it difficult to achieve strict alignment between the source images. Direct fusion of such misaligned pairs leads to ghosting artifacts, which significantly compromises driving safety. To address this challenge, this paper proposes a cascaded deep fusion framework tailored for autonomous driving scenarios. A dual-modal perception dataset is first constructed, incorporating realistic physical parallax and non-rigid deformations. Subsequently, a decoupled strategy is established, characterized by geometric correction followed by semantic fusion: the Static-Feature Recursive Registration (SFRR) network is utilized to explicitly correct the spatial misalignments caused by parallax, thereby establishing geometric consistency; then, the Hierarchical Invertible Block Fusion (HIBF) network achieves lossless integration of cross-modal features by combining spatial frequency separation with invertible interaction techniques. Experimental results demonstrate that the proposed method outperforms representative algorithms across several metrics, including Mutual Information (MI), Visual Information Fidelity (VIF), Structural Similarity (SSIM), and Correlation Coefficient (CC), producing high-quality fused images with clear structural definitions.
Förderung
- Beijing Institute of Technology https://ror.org/01skt4w74
Zitieren
APA
Xiao, L., Xie, Y., & Yao, C. (2026). Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving. Electronics, 15(7), 1427. https://doi.org/10.3390/electronics15071427
Vancouver
Xiao L, Xie Y, Yao C. Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving. Electronics. 2026;15(7):1427. doi:10.3390/electronics15071427
BibTeX
@article{Xiao2026,
author = {Xiao, Long and Xie, Yidong and Yao, Chengda},
title = {Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving},
journal = {Electronics},
year = {2026},
volume = {15},
number = {7},
pages = {1427},
doi = {10.3390/electronics15071427}
}
EUVIMED