VD-Matcher: A Very Deep Local Feature Matcher With Weight Recycling and Keypoint Detection
IEEE Transactions on Circuits and Systems for Video Technology · 2025-11 · 35 (11) · 11416-11431
DOI: 10.1109/tcsvt.2025.3574735 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-11. Verfasst von Kun Dai und 8 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Open Research Fund of Anhui Province Key Laboratory of Machine Vision Inspection, Self-Planned Task of State Key Laboratory of Robotics and Systems (SKLRS) [Harbin Institute of Technology (HIT)] of China.
Abstract (Originalsprache)
Establishing local feature matches between image pairs serves as a fundamental component of plentiful vision tasks, such as visual localization and Structure from Motion (SfM). Recently, detector-free techniques equipped with the transformer have exhibited exceptional performance. Theoretically, optimizing the transformer architecture and stacking more transformer blocks could emphasize crucial features and filter out extraneous information by progressively narrowing the effective perception regions of the network within images, thereby enhancing the matching performance. Nevertheless, this paradigm results in a linear escalation of model size with respect to the number of blocks. In this study, we introduce VD-Matcher to address this issue. A principal innovation of VD-Matcher is the utilization of a weight recycling technique (WRT) that enables partial weights to be reutilized across successive transformer blocks, along with specific transformations designed to sufficiently enhance feature representations. This approach enables VD-Matcher to construct a deep transformer architecture for accurate local feature matching while maintaining a manageable parameter size. Furthermore, we propose a lightweight multi-scale keypoint detection module that captures representative keypoints to replace all keypoints for compact global information aggregation intra-/inter- images, which reduces the computational overhead induced by excessively deep transformer layers while alleviating redundant information propagation to a certain extent. Extensive experiments verify that VD-Matcher exceeds state-of-the-art algorithms on multiple benchmarks while maintaining less parameters. The source code is available at https://github.com/mooncake199809/VD-Matcher
Förderung
- National Natural Science Foundation of China
- Open Research Fund of Anhui Province Key Laboratory of Machine Vision Inspection
- Self-Planned Task of State Key Laboratory of Robotics and Systems (SKLRS) [Harbin Institute of Technology (HIT)] of China
Zitieren
APA
Dai, K., Zhou, Z., Jiang, Z., Sun, Q., Xie, T., Gao, H., An, T., Li, R., & Zhao, L. (2025). VD-Matcher: A Very Deep Local Feature Matcher With Weight Recycling and Keypoint Detection. IEEE Transactions on Circuits and Systems for Video Technology, 35(11), 11416-11431. https://doi.org/10.1109/tcsvt.2025.3574735
Vancouver
Dai K, Zhou Z, Jiang Z, Sun Q, Xie T, Gao H, et al. VD-Matcher: A Very Deep Local Feature Matcher With Weight Recycling and Keypoint Detection. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(11):11416-11431. doi:10.1109/tcsvt.2025.3574735
BibTeX
@article{Dai2025,
author = {Dai, Kun and Zhou, Zilong and Jiang, Zhiqiang and Sun, Qihao and Xie, Tao and Gao, Hongbo and An, Tao and Li, Ruifeng and Zhao, Lijun},
title = {VD-Matcher: A Very Deep Local Feature Matcher With Weight Recycling and Keypoint Detection},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2025},
volume = {35},
number = {11},
pages = {11416--11431},
doi = {10.1109/tcsvt.2025.3574735}
}
EUVIMED