CLASP: General-purpose clothes manipulation with semantic keypoints
The International Journal of Robotics Research · 18.08.2026
DOI: 10.1177/02783649261478649 ↗Kurz gefasst
Fachartikel in der Zeitschrift The International Journal of Robotics Research, online erschienen am 18.08.2026. Verfasst von Yuhong Deng und 4 weiteren Autor:innen. Die Arbeit nennt 93 Literaturangaben. Gefördert von: Ministry of Digital Development & Information, Singapore, NUS Research Scholarship.
Abstract (Originalsprache)
Clothes manipulation, such as folding or hanging, is a critical capability for home service robots. Despite recent advances, most existing methods remain limited to specific clothes types and tasks due to the complex, high-dimensional geometry of clothes. This paper presents CLothes mAnipulation with Semantic keyPoints (CLASP). CLASP aims at general-purpose clothes manipulation across diverse clothes types, such as T-shirts, shorts, skirts, long dresses, … and across different tasks, such as folding, flattening, hanging, …. The key idea of CLASP is semantic keypoints —for example, “left sleeve” and “right shoulder”—a sparse spatial-semantic representation, salient for both perception and action. Semantic keypoints of clothes can be reliably extracted from RGB-D images and provide an effective representation for a wide range of clothes manipulation policies. CLASP uses semantic keypoints as an intermediate representation to connect high-level task planning and low-level action execution. At the high level, it exploits a vision-language model (VLM) to predict task plans over the semantic keypoints. At the low level, it executes the plans with the help of a set of pre-built manipulation skills conditioned on the keypoints. Extensive simulation experiments show that CLASP outperforms state-of-the-art baseline methods on multiple tasks across diverse clothes types, demonstrating strong performance and generalization. Further experiments with a Franka dual-arm system on four distinct tasks—folding, flattening, hanging, and placing—confirm CLASP’s performance on real-life clothes manipulation.
Förderung
- Ministry of Digital Development & Information, Singapore
- NUS Research Scholarship
Zitieren
APA
Deng, Y., Tang, C., Yu, C., Li, L., & Hsu, D. (2026). CLASP: General-purpose clothes manipulation with semantic keypoints. The International Journal of Robotics Research. https://doi.org/10.1177/02783649261478649
Vancouver
Deng Y, Tang C, Yu C, Li L, Hsu D. CLASP: General-purpose clothes manipulation with semantic keypoints. The International Journal of Robotics Research. 2026. doi:10.1177/02783649261478649
BibTeX
@article{Deng2026,
author = {Deng, Yuhong and Tang, Chao and Yu, Cunjun and Li, Linfeng and Hsu, David},
title = {CLASP: General-purpose clothes manipulation with semantic keypoints},
journal = {The International Journal of Robotics Research},
year = {2026},
doi = {10.1177/02783649261478649}
}
EUVIMED