Learning a Contact Potential Field for Modeling the Hand-Object Interaction
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-08 · 46 (8) · 5645-5662
DOI: 10.1109/tpami.2024.3372102 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-08. Verfasst von Lixin Yang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 71 Literaturangaben. Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, Shanghai Qi Zhi Institute.
Abstract (Originalsprache)
Estimating and synthesizing the hand's manipulation of objects is central to understanding human behaviour. To accurately model the interaction between the hand and object (referred to as the "hand-object"), we must not only focus on the pose of the hand and object, but also consider the contact between them. This contact provides valuable information for generating semantically and physically plausible grasps. In this paper, we propose an explicit contact representation called Contact Potential Field (CPF). In CPF, we model the contact between a pair of hand-object vertices as a spring-mass system. This system encodes the distance of the pair, as well as a likelihood of that contact being stable. Therefore, the system of multiple extended and compressed springs forms an elastic potential field with minimal energy at the optimal grasp position. We apply CPF to two relevant tasks, namely, hand-object pose estimation and grasping pose generation. Extensive experiments on the two challenging tasks and three commonly used datasets have demonstrated that our method can achieve state-of-the-art in several reconstruction metrics, allowing us to produce more physically plausible hand-object poses even when the ground-truth exhibits severe interpenetration or disjointedness.
Förderung
- National Key R&D Program of China
- National Natural Science Foundation of China
- Shanghai Qi Zhi Institute
Zitieren
APA
Yang, L., Zhan, X., Li, K., Xu, W., Zhang, J., Li, J., & Lu, C. (2024). Learning a Contact Potential Field for Modeling the Hand-Object Interaction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(8), 5645-5662. https://doi.org/10.1109/tpami.2024.3372102
Vancouver
Yang L, Zhan X, Li K, Xu W, Zhang J, Li J, et al. Learning a Contact Potential Field for Modeling the Hand-Object Interaction. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(8):5645-5662. doi:10.1109/tpami.2024.3372102
BibTeX
@article{Yang2024,
author = {Yang, Lixin and Zhan, Xinyu and Li, Kailin and Xu, Wenqiang and Zhang, Junming and Li, Jiefeng and Lu, Cewu},
title = {Learning a Contact Potential Field for Modeling the Hand-Object Interaction},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2024},
volume = {46},
number = {8},
pages = {5645--5662},
doi = {10.1109/tpami.2024.3372102}
}
EUVIMED