HFTM: A Hierarchical Feature Transformer Framework With Multiscale Consensus for SAR–Optical Image Registration
IEEE Geoscience and Remote Sensing Letters · 2026 · 23 · 1-5
DOI: 10.1109/lgrs.2026.3663870 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Geoscience and Remote Sensing Letters, 2026. Verfasst von Xiangyue Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 13 Literaturangaben. Gefördert von: Natural Science Foundation of China, Natural Science Foundation of Liaoning Province, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Synthetic aperture radar (SAR) and optical image matching are critical prerequisites for achieving image fusion. Due to nonlinear radiometric differences and geometric distortions between SAR and optical images, existing methods struggle to extract homologous feature points, resulting in suboptimal registration accuracy. To address the mismatch issues in SAR–optical cross-modal image matching, a feature-based matching method named HFTM is proposed in this letter. First, a hierarchical feature extraction network is applied to multimodal image pairs to extract global and local context information to obtain robust feature points. Consistent feature matching is then achieved in the local region through a Transformer-based attention mechanism and NeighConsensus (TNC) matching network. The results of local matching are fed into the proposed global position-encoded probabilistic (P2) matching network, which employs a detailed matching layer to generate an enhanced feature map and predicts robust matching point pairs by a spatial expectation operator. Experimental results demonstrate the superior performance of our method, achieving a single responsiveness estimation accuracy of 89.43% on QXS-SAROPT and 86.21% on SEN12MS at a five-pixel threshold.
Förderung
- Natural Science Foundation of China
- Natural Science Foundation of Liaoning Province
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Zhang, X., Zhang, B., Ru, J., & Wu, C. (2026). HFTM: A Hierarchical Feature Transformer Framework With Multiscale Consensus for SAR–Optical Image Registration. IEEE Geoscience and Remote Sensing Letters, 23, 1-5. https://doi.org/10.1109/lgrs.2026.3663870
Vancouver
Zhang X, Zhang B, Ru J, Wu C. HFTM: A Hierarchical Feature Transformer Framework With Multiscale Consensus for SAR–Optical Image Registration. IEEE Geoscience and Remote Sensing Letters. 2026;23:1-5. doi:10.1109/lgrs.2026.3663870
BibTeX
@article{Zhang2026,
author = {Zhang, Xiangyue and Zhang, Benxin and Ru, Jingyu and Wu, Chengdong},
title = {HFTM: A Hierarchical Feature Transformer Framework With Multiscale Consensus for SAR–Optical Image Registration},
journal = {IEEE Geoscience and Remote Sensing Letters},
year = {2026},
volume = {23},
pages = {1--5},
doi = {10.1109/lgrs.2026.3663870}
}
EUVIMED