EUVIMEDSkopri EUVIMED
Open access · CC BY 4.0

Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving

Long Xiao, Yidong Xie, Chengda Yao

Electronics · 2026-03-30 · 15 (7) · 1427

DOI: 10.3390/electronics15071427 ↗

At a glance

Journal article in Electronics, published online on 2026-03-30. Written by Long Xiao and 2 co-authors. 47 references. The full text is freely available (open access, CC BY 4.0). Funded by: Beijing Institute of Technology https://ror.org/01skt4w74.

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Infrared and visible image fusion is a critical technology for enhancing the all-weather perception capabilities of autonomous driving systems. However, the inherent physical parallax of vehicle-mounted sensors combined with motion-induced vibrations makes it difficult to achieve strict alignment between the source images. Direct fusion of such misaligned pairs leads to ghosting artifacts, which significantly compromises driving safety. To address this challenge, this paper proposes a cascaded deep fusion framework tailored for autonomous driving scenarios. A dual-modal perception dataset is first constructed, incorporating realistic physical parallax and non-rigid deformations. Subsequently, a decoupled strategy is established, characterized by geometric correction followed by semantic fusion: the Static-Feature Recursive Registration (SFRR) network is utilized to explicitly correct the spatial misalignments caused by parallax, thereby establishing geometric consistency; then, the Hierarchical Invertible Block Fusion (HIBF) network achieves lossless integration of cross-modal features by combining spatial frequency separation with invertible interaction techniques. Experimental results demonstrate that the proposed method outperforms representative algorithms across several metrics, including Mutual Information (MI), Visual Information Fidelity (VIF), Structural Similarity (SSIM), and Correlation Coefficient (CC), producing high-quality fused images with clear structural definitions.

Funding

  • Beijing Institute of Technology https://ror.org/01skt4w74

Cite

APA

Xiao, L., Xie, Y., & Yao, C. (2026). Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving. Electronics, 15(7), 1427. https://doi.org/10.3390/electronics15071427

Vancouver

Xiao L, Xie Y, Yao C. Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving. Electronics. 2026;15(7):1427. doi:10.3390/electronics15071427

BibTeX
@article{Xiao2026,
  author = {Xiao, Long and Xie, Yidong and Yao, Chengda},
  title = {Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {7},
  pages = {1427},
  doi = {10.3390/electronics15071427}
}
Start for free →