SFK: Shape‐ and Function‐Grounded Keypoint Representation for Sequential Manipulation
CAAI Transactions on Intelligence Technology · 2026-10 · 11 (5) · 1396-1412
DOI: 10.1049/cit2.70136 ↗Kurz gefasst
Fachartikel in der Zeitschrift CAAI Transactions on Intelligence Technology, online erschienen am 22.04.2026. Verfasst von Yaxin Liu und 7 weiteren Autor:innen. Die Arbeit nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: National Key Research and Development Program of China.
Abstract (Originalsprache)
Sequential manipulation is the process by which robots perform multiple interdependent steps to accomplish composite tasks, demanding tight integration of perception, planning and execution. Existing methods incorporate explicit features such as category, semantics, 6D pose or affordance to enhance consistency, yet single‐feature representations limit generalisation and adaptability across diverse task stages. To overcome these limitations, we propose a shape‐ and function‐grounded keypoint (SFK) representation that provides interpretable, task‐relevant object abstractions. The SFK representation preserves topological consistency, enabling the inference of functional semantics, 6D pose, spatial constraints and task‐oriented grasp configurations. Building upon this, a keypoint‐driven hierarchical framework is developed to unify perception, planning and execution, thereby enabling task‐level action reasoning conditioned on keypoint representations and coherent multistep action execution. For evaluation, a keypoint dataset containing over 1600 RGB images of 29 household objects is constructed, and extensive experiments demonstrate task‐relevant keypoint generation with reduced computational time, as well as higher task execution success rates and broader task coverage.
Förderung
- National Key Research and Development Program of China
Zitieren
APA
Liu, Y., Liu, Y., Song, X., Han, R., Liu, H., Huang, B., Yao, Y., & Zhong, M. (2026). SFK: Shape‐ and Function‐Grounded Keypoint Representation for Sequential Manipulation. CAAI Transactions on Intelligence Technology, 11(5), 1396-1412. https://doi.org/10.1049/cit2.70136
Vancouver
Liu Y, Liu Y, Song X, Han R, Liu H, Huang B, et al. SFK: Shape‐ and Function‐Grounded Keypoint Representation for Sequential Manipulation. CAAI Transactions on Intelligence Technology. 2026;11(5):1396-1412. doi:10.1049/cit2.70136
BibTeX
@article{Liu2026,
author = {Liu, Yaxin and Liu, Yan and Song, Xinyu and Han, Ruiqing and Liu, Haiyong and Huang, Bo and Yao, Yufeng and Zhong, Ming},
title = {SFK: Shape‐ and Function‐Grounded Keypoint Representation for Sequential Manipulation},
journal = {CAAI Transactions on Intelligence Technology},
year = {2026},
volume = {11},
number = {5},
pages = {1396--1412},
doi = {10.1049/cit2.70136}
}
EUVIMED