Covariant Peak Constraint for Accurate Keypoint Detection and Keypoint-Specific Descriptor Learning
IEEE Transactions on Multimedia · 2024 · 26 · 5383-5397
DOI: 10.1109/tmm.2023.3333211 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Multimedia, 2024. Verfasst von Yujie Fu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 56 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.
Abstract (Originalsprache)
Local feature extraction consists of keypoint detection and local descriptor extraction. Firstly, in keypoint detector learning, existing covariance constraint loss functions cannot constrain the probability distribution shapes in local probability maps that surround keypoints. And existing auxiliary peak loss functions, which are used to alleviate the problem, impair the performance of local feature methods. To solve this problem, we propose a novel Covariant Peak constraint Loss (CP Loss) which is defined as the expectations of local probability maps' position errors. Minimizing our CP Loss can make local probability maps accurately peak at reliable keypoints. Secondly, in descriptor learning, the Neural Reprojection Error (NRE) aims at constraining dense descriptor maps of images. But we argue that only those descriptors of keypoints need to be constrained. Thus, we propose a novel Conditional Neural Reprojection Error (CNRE) that is only conditioned on keypoints. Compared with the NRE, our CNRE can achieve much higher efficiency and produce more keypoint-specific descriptors with better matching performance. We use our CP Loss and CNRE to train a local feature network named as CPCN-Feat. Experimental results show that our CPCN-Feat achieves state-of-the-art performance on four challenging benchmarks.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
Zitieren
APA
Fu, Y., Zhang, P., Tang, F., & Wu, Y. (2024). Covariant Peak Constraint for Accurate Keypoint Detection and Keypoint-Specific Descriptor Learning. IEEE Transactions on Multimedia, 26, 5383-5397. https://doi.org/10.1109/tmm.2023.3333211
Vancouver
Fu Y, Zhang P, Tang F, Wu Y. Covariant Peak Constraint for Accurate Keypoint Detection and Keypoint-Specific Descriptor Learning. IEEE Transactions on Multimedia. 2024;26:5383-5397. doi:10.1109/tmm.2023.3333211
BibTeX
@article{Fu2024,
author = {Fu, Yujie and Zhang, Pengju and Tang, Fulin and Wu, Yihong},
title = {Covariant Peak Constraint for Accurate Keypoint Detection and Keypoint-Specific Descriptor Learning},
journal = {IEEE Transactions on Multimedia},
year = {2024},
volume = {26},
pages = {5383--5397},
doi = {10.1109/tmm.2023.3333211}
}
EUVIMED