EUVIMEDEUVIMED entdecken
Crossref

GRiD: Guided Refinement for Detector-Free Multimodal Image Matching

Yuyan Liu, Wei He, Hongyan Zhang

IEEE Transactions on Image Processing · 2024 · 33 · 5892-5906

DOI: 10.1109/tip.2024.3472491 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2024. Verfasst von Yuyan Liu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 75 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal image matching is essential in image stitching, image fusion, change detection, and land cover mapping. However, the severe nonlinear radiometric distortion (NRD) and geometric distortions in multimodal images severely limit the accuracy of multimodal image matching, posing significant challenges to existing methods. Additionally, detector-based methods are prone to feature point offset issues in regions with substantial modal differences, which also hinder the subsequent fine registration and fusion of images. To address these challenges, we propose a guided refinement for detector-free multimodal image matching (GRiD) method, which weakens feature point offset issues by establishing pixel-level correspondences and utilizes reference points to guide and correct matches affected by NRD and geometric distortions. Specifically, we first introduce a detector-free framework to alleviate the feature point offset problem by directly finding corresponding pixels between images. Subsequently, to tackle NRD and geometric distortion in multimodal images, we design a guided correction module that establishes robust reference points (RPs) to guide the search for corresponding pixels in regions with significant modality differences. Moreover, to enhance RPs reliability, we incorporate a phase congruency module during the RPs confirmation stage to concentrate RPs around image edge structures. Finally, we perform finer localization on highly correlated corresponding pixels to obtain the optimized matches. We conduct extensive experiments on four multimodal image datasets to validate the effectiveness of the proposed approach. Experimental results demonstrate that our method can achieve sufficient and robust matches across various modality images and effectively suppress the feature point offset problem.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Liu, Y., He, W., & Zhang, H. (2024). GRiD: Guided Refinement for Detector-Free Multimodal Image Matching. IEEE Transactions on Image Processing, 33, 5892-5906. https://doi.org/10.1109/tip.2024.3472491

Vancouver

Liu Y, He W, Zhang H. GRiD: Guided Refinement for Detector-Free Multimodal Image Matching. IEEE Transactions on Image Processing. 2024;33:5892-5906. doi:10.1109/tip.2024.3472491

BibTeX
@article{Liu2024,
  author = {Liu, Yuyan and He, Wei and Zhang, Hongyan},
  title = {GRiD: Guided Refinement for Detector-Free Multimodal Image Matching},
  journal = {IEEE Transactions on Image Processing},
  year = {2024},
  volume = {33},
  pages = {5892--5906},
  doi = {10.1109/tip.2024.3472491}
}
Kostenlos starten →