EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving

Long Xiao, Yidong Xie, Chengda Yao

Electronics · 30.03.2026 · 15 (7) · 1427

DOI: 10.3390/electronics15071427 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 30.03.2026. Verfasst von Long Xiao und 2 weiteren Autor:innen. Die Arbeit nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Beijing Institute of Technology https://ror.org/01skt4w74.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Infrared and visible image fusion is a critical technology for enhancing the all-weather perception capabilities of autonomous driving systems. However, the inherent physical parallax of vehicle-mounted sensors combined with motion-induced vibrations makes it difficult to achieve strict alignment between the source images. Direct fusion of such misaligned pairs leads to ghosting artifacts, which significantly compromises driving safety. To address this challenge, this paper proposes a cascaded deep fusion framework tailored for autonomous driving scenarios. A dual-modal perception dataset is first constructed, incorporating realistic physical parallax and non-rigid deformations. Subsequently, a decoupled strategy is established, characterized by geometric correction followed by semantic fusion: the Static-Feature Recursive Registration (SFRR) network is utilized to explicitly correct the spatial misalignments caused by parallax, thereby establishing geometric consistency; then, the Hierarchical Invertible Block Fusion (HIBF) network achieves lossless integration of cross-modal features by combining spatial frequency separation with invertible interaction techniques. Experimental results demonstrate that the proposed method outperforms representative algorithms across several metrics, including Mutual Information (MI), Visual Information Fidelity (VIF), Structural Similarity (SSIM), and Correlation Coefficient (CC), producing high-quality fused images with clear structural definitions.

Förderung

  • Beijing Institute of Technology https://ror.org/01skt4w74

Zitieren

APA

Xiao, L., Xie, Y., & Yao, C. (2026). Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving. Electronics, 15(7), 1427. https://doi.org/10.3390/electronics15071427

Vancouver

Xiao L, Xie Y, Yao C. Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving. Electronics. 2026;15(7):1427. doi:10.3390/electronics15071427

BibTeX
@article{Xiao2026,
  author = {Xiao, Long and Xie, Yidong and Yao, Chengda},
  title = {Cascade Registration and Fusion for Unaligned Infrared and Visible Images in Autonomous Driving},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {7},
  pages = {1427},
  doi = {10.3390/electronics15071427}
}
Kostenlos starten →