EUVIMEDEUVIMED entdecken
Crossref

ContextMatcher: Detector-Free Feature Matching With Cross-Modality Context

Dongyue Li, Songlin Du

IEEE Transactions on Circuits and Systems for Video Technology · 2024-09 · 34 (9) · 7922-7934

DOI: 10.1109/tcsvt.2024.3383334 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-09. Verfasst von Dongyue Li und 1 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 57 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Jiangsu Province, Shenzhen Science and Technology Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Existing feature matching methods tend to extract feature descriptors by relying on the visual appearance, leading to false matches which are obviously false from the geometric perspective. This paper proposes ContextMatcher, which goes beyond the visual appearance representation by introducing the geometric context to guild the feature matching. Specifically, our ContextMatcher includes visual descriptors generation, the neighborhood consensus module, and the geometric context encoder. To learn visual descriptors, Transformers situated in different branches are leveraged to obtain feature descriptors. In one branch, convolutions are integrated into self-attention layers elegantly to compensate for the lack of the local structure information. In another branch, a cross-scale Transformer is proposed through injecting heterogeneous receptive field sizes into tokens. To leverage and aggregate the geometric contextual information, a neighborhood consensus mechanism is proposed by re-ranking initial pixel-level matches to make a constraint of geometric consensus on neighborhood feature descriptors. Moreover, local feature descriptors are boosted through combining with the geometric properties of keypoints for refining matches to the sub-pixel level. Extensive experiments on relative pose estimations and image matching show that our proposed method outperforms existing state-of-the-art methods by a large margin.

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Jiangsu Province
  • Shenzhen Science and Technology Program

Zitieren

APA

Li, D., & Du, S. (2024). ContextMatcher: Detector-Free Feature Matching With Cross-Modality Context. IEEE Transactions on Circuits and Systems for Video Technology, 34(9), 7922-7934. https://doi.org/10.1109/tcsvt.2024.3383334

Vancouver

Li D, Du S. ContextMatcher: Detector-Free Feature Matching With Cross-Modality Context. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(9):7922-7934. doi:10.1109/tcsvt.2024.3383334

BibTeX
@article{Li2024,
  author = {Li, Dongyue and Du, Songlin},
  title = {ContextMatcher: Detector-Free Feature Matching With Cross-Modality Context},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {9},
  pages = {7922--7934},
  doi = {10.1109/tcsvt.2024.3383334}
}
Kostenlos starten →