EUVIMEDEUVIMED entdecken
Crossref

Learning a Contact Potential Field for Modeling the Hand-Object Interaction

Lixin Yang, Xinyu Zhan, Kailin Li, Wenqiang Xu, Junming Zhang, Jiefeng Li, Cewu Lu

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-08 · 46 (8) · 5645-5662

DOI: 10.1109/tpami.2024.3372102 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-08. Verfasst von Lixin Yang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 71 Literaturangaben. Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, Shanghai Qi Zhi Institute.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Estimating and synthesizing the hand's manipulation of objects is central to understanding human behaviour. To accurately model the interaction between the hand and object (referred to as the "hand-object"), we must not only focus on the pose of the hand and object, but also consider the contact between them. This contact provides valuable information for generating semantically and physically plausible grasps. In this paper, we propose an explicit contact representation called Contact Potential Field (CPF). In CPF, we model the contact between a pair of hand-object vertices as a spring-mass system. This system encodes the distance of the pair, as well as a likelihood of that contact being stable. Therefore, the system of multiple extended and compressed springs forms an elastic potential field with minimal energy at the optimal grasp position. We apply CPF to two relevant tasks, namely, hand-object pose estimation and grasping pose generation. Extensive experiments on the two challenging tasks and three commonly used datasets have demonstrated that our method can achieve state-of-the-art in several reconstruction metrics, allowing us to produce more physically plausible hand-object poses even when the ground-truth exhibits severe interpenetration or disjointedness.

Förderung

  • National Key R&D Program of China
  • National Natural Science Foundation of China
  • Shanghai Qi Zhi Institute

Zitieren

APA

Yang, L., Zhan, X., Li, K., Xu, W., Zhang, J., Li, J., & Lu, C. (2024). Learning a Contact Potential Field for Modeling the Hand-Object Interaction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(8), 5645-5662. https://doi.org/10.1109/tpami.2024.3372102

Vancouver

Yang L, Zhan X, Li K, Xu W, Zhang J, Li J, et al. Learning a Contact Potential Field for Modeling the Hand-Object Interaction. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(8):5645-5662. doi:10.1109/tpami.2024.3372102

BibTeX
@article{Yang2024,
  author = {Yang, Lixin and Zhan, Xinyu and Li, Kailin and Xu, Wenqiang and Zhang, Junming and Li, Jiefeng and Lu, Cewu},
  title = {Learning a Contact Potential Field for Modeling the Hand-Object Interaction},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2024},
  volume = {46},
  number = {8},
  pages = {5645--5662},
  doi = {10.1109/tpami.2024.3372102}
}
Kostenlos starten →