Harmonized Domain Enabled Alternate Search for Infrared and Visible Image Alignment
IEEE Transactions on Image Processing · 2025 · 34 · 5832-5846
DOI: 10.1109/tip.2025.3607585 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2025. Verfasst von Zhiying Jiang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 75 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, China Postdoctoral Science Foundation.
Abstract (Originalsprache)
Infrared and visible image alignment is essential and critical to the fusion and multi-modal perception applications. It addresses discrepancies in position and scale caused by spectral properties and environmental variations, ensuring precise pixel correspondence and spatial consistency. Existing manual calibration requires regular maintenance and exhibits poor portability, challenging the adaptability of multi-modal application in dynamic environments. In this paper, we propose a harmonized representation based infrared and visible image alignment, achieving both high accuracy and scene adaptability. Specifically, with regard to the disparity between multi-modal images, we develop an invertible translation process to establish a harmonized representation domain that effectively encapsulates the feature intensity and distribution of both infrared and visible modalities. Building on this, we design a hierarchical framework to correct deformations inferred from the harmonized domain in a coarse-to-fine manner. Our framework leverages advanced perception capabilities alongside residual estimation to enable accurate regression of sparse offsets, while an alternate correlation search mechanism ensures precise correspondence matching. Furthermore, we propose the first ground truth available misaligned infrared and visible image benchmark for evaluation. Extensive experiments validate the effectiveness of the proposed method against the state-of-the-arts, advancing the subsequent applications further. Code and dataset are available at https://github.com/Jzy2017/HR4IR.
Förderung
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- China Postdoctoral Science Foundation
Zitieren
APA
Jiang, Z., Zhang, Z., & Liu, J. (2025). Harmonized Domain Enabled Alternate Search for Infrared and Visible Image Alignment. IEEE Transactions on Image Processing, 34, 5832-5846. https://doi.org/10.1109/tip.2025.3607585
Vancouver
Jiang Z, Zhang Z, Liu J. Harmonized Domain Enabled Alternate Search for Infrared and Visible Image Alignment. IEEE Transactions on Image Processing. 2025;34:5832-5846. doi:10.1109/tip.2025.3607585
BibTeX
@article{Jiang2025,
author = {Jiang, Zhiying and Zhang, Zengxi and Liu, Jinyuan},
title = {Harmonized Domain Enabled Alternate Search for Infrared and Visible Image Alignment},
journal = {IEEE Transactions on Image Processing},
year = {2025},
volume = {34},
pages = {5832--5846},
doi = {10.1109/tip.2025.3607585}
}
EUVIMED