EUVIMEDEUVIMED entdecken
Crossref

VD-Matcher: A Very Deep Local Feature Matcher With Weight Recycling and Keypoint Detection

Kun Dai, Zilong Zhou, Zhiqiang Jiang, Qihao Sun, Tao Xie, Hongbo Gao, Tao An, Ruifeng Li, Lijun Zhao

IEEE Transactions on Circuits and Systems for Video Technology · 2025-11 · 35 (11) · 11416-11431

DOI: 10.1109/tcsvt.2025.3574735 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-11. Verfasst von Kun Dai und 8 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Open Research Fund of Anhui Province Key Laboratory of Machine Vision Inspection, Self-Planned Task of State Key Laboratory of Robotics and Systems (SKLRS) [Harbin Institute of Technology (HIT)] of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Establishing local feature matches between image pairs serves as a fundamental component of plentiful vision tasks, such as visual localization and Structure from Motion (SfM). Recently, detector-free techniques equipped with the transformer have exhibited exceptional performance. Theoretically, optimizing the transformer architecture and stacking more transformer blocks could emphasize crucial features and filter out extraneous information by progressively narrowing the effective perception regions of the network within images, thereby enhancing the matching performance. Nevertheless, this paradigm results in a linear escalation of model size with respect to the number of blocks. In this study, we introduce VD-Matcher to address this issue. A principal innovation of VD-Matcher is the utilization of a weight recycling technique (WRT) that enables partial weights to be reutilized across successive transformer blocks, along with specific transformations designed to sufficiently enhance feature representations. This approach enables VD-Matcher to construct a deep transformer architecture for accurate local feature matching while maintaining a manageable parameter size. Furthermore, we propose a lightweight multi-scale keypoint detection module that captures representative keypoints to replace all keypoints for compact global information aggregation intra-/inter- images, which reduces the computational overhead induced by excessively deep transformer layers while alleviating redundant information propagation to a certain extent. Extensive experiments verify that VD-Matcher exceeds state-of-the-art algorithms on multiple benchmarks while maintaining less parameters. The source code is available at https://github.com/mooncake199809/VD-Matcher

Förderung

  • National Natural Science Foundation of China
  • Open Research Fund of Anhui Province Key Laboratory of Machine Vision Inspection
  • Self-Planned Task of State Key Laboratory of Robotics and Systems (SKLRS) [Harbin Institute of Technology (HIT)] of China

Zitieren

APA

Dai, K., Zhou, Z., Jiang, Z., Sun, Q., Xie, T., Gao, H., An, T., Li, R., & Zhao, L. (2025). VD-Matcher: A Very Deep Local Feature Matcher With Weight Recycling and Keypoint Detection. IEEE Transactions on Circuits and Systems for Video Technology, 35(11), 11416-11431. https://doi.org/10.1109/tcsvt.2025.3574735

Vancouver

Dai K, Zhou Z, Jiang Z, Sun Q, Xie T, Gao H, et al. VD-Matcher: A Very Deep Local Feature Matcher With Weight Recycling and Keypoint Detection. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(11):11416-11431. doi:10.1109/tcsvt.2025.3574735

BibTeX
@article{Dai2025,
  author = {Dai, Kun and Zhou, Zilong and Jiang, Zhiqiang and Sun, Qihao and Xie, Tao and Gao, Hongbo and An, Tao and Li, Ruifeng and Zhao, Lijun},
  title = {VD-Matcher: A Very Deep Local Feature Matcher With Weight Recycling and Keypoint Detection},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2025},
  volume = {35},
  number = {11},
  pages = {11416--11431},
  doi = {10.1109/tcsvt.2025.3574735}
}
Kostenlos starten →