EUVIMEDEUVIMED entdecken
Crossref

HFTM: A Hierarchical Feature Transformer Framework With Multiscale Consensus for SAR–Optical Image Registration

Xiangyue Zhang, Benxin Zhang, Jingyu Ru, Chengdong Wu

IEEE Geoscience and Remote Sensing Letters · 2026 · 23 · 1-5

DOI: 10.1109/lgrs.2026.3663870 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Geoscience and Remote Sensing Letters, 2026. Verfasst von Xiangyue Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 13 Literaturangaben. Gefördert von: Natural Science Foundation of China, Natural Science Foundation of Liaoning Province, Fundamental Research Funds for the Central Universities.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Synthetic aperture radar (SAR) and optical image matching are critical prerequisites for achieving image fusion. Due to nonlinear radiometric differences and geometric distortions between SAR and optical images, existing methods struggle to extract homologous feature points, resulting in suboptimal registration accuracy. To address the mismatch issues in SAR–optical cross-modal image matching, a feature-based matching method named HFTM is proposed in this letter. First, a hierarchical feature extraction network is applied to multimodal image pairs to extract global and local context information to obtain robust feature points. Consistent feature matching is then achieved in the local region through a Transformer-based attention mechanism and NeighConsensus (TNC) matching network. The results of local matching are fed into the proposed global position-encoded probabilistic (P2) matching network, which employs a detailed matching layer to generate an enhanced feature map and predicts robust matching point pairs by a spatial expectation operator. Experimental results demonstrate the superior performance of our method, achieving a single responsiveness estimation accuracy of 89.43% on QXS-SAROPT and 86.21% on SEN12MS at a five-pixel threshold.

Förderung

  • Natural Science Foundation of China
  • Natural Science Foundation of Liaoning Province
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Zhang, X., Zhang, B., Ru, J., & Wu, C. (2026). HFTM: A Hierarchical Feature Transformer Framework With Multiscale Consensus for SAR–Optical Image Registration. IEEE Geoscience and Remote Sensing Letters, 23, 1-5. https://doi.org/10.1109/lgrs.2026.3663870

Vancouver

Zhang X, Zhang B, Ru J, Wu C. HFTM: A Hierarchical Feature Transformer Framework With Multiscale Consensus for SAR–Optical Image Registration. IEEE Geoscience and Remote Sensing Letters. 2026;23:1-5. doi:10.1109/lgrs.2026.3663870

BibTeX
@article{Zhang2026,
  author = {Zhang, Xiangyue and Zhang, Benxin and Ru, Jingyu and Wu, Chengdong},
  title = {HFTM: A Hierarchical Feature Transformer Framework With Multiscale Consensus for SAR–Optical Image Registration},
  journal = {IEEE Geoscience and Remote Sensing Letters},
  year = {2026},
  volume = {23},
  pages = {1--5},
  doi = {10.1109/lgrs.2026.3663870}
}
Kostenlos starten →