EUVIMEDEUVIMED entdecken
Crossref

CLASP: General-purpose clothes manipulation with semantic keypoints

Yuhong Deng, Chao Tang, Cunjun Yu, Linfeng Li, David Hsu

The International Journal of Robotics Research · 18.08.2026

DOI: 10.1177/02783649261478649 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The International Journal of Robotics Research, online erschienen am 18.08.2026. Verfasst von Yuhong Deng und 4 weiteren Autor:innen. Die Arbeit nennt 93 Literaturangaben. Gefördert von: Ministry of Digital Development & Information, Singapore, NUS Research Scholarship.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Clothes manipulation, such as folding or hanging, is a critical capability for home service robots. Despite recent advances, most existing methods remain limited to specific clothes types and tasks due to the complex, high-dimensional geometry of clothes. This paper presents CLothes mAnipulation with Semantic keyPoints (CLASP). CLASP aims at general-purpose clothes manipulation across diverse clothes types, such as T-shirts, shorts, skirts, long dresses, … and across different tasks, such as folding, flattening, hanging, …. The key idea of CLASP is semantic keypoints —for example, “left sleeve” and “right shoulder”—a sparse spatial-semantic representation, salient for both perception and action. Semantic keypoints of clothes can be reliably extracted from RGB-D images and provide an effective representation for a wide range of clothes manipulation policies. CLASP uses semantic keypoints as an intermediate representation to connect high-level task planning and low-level action execution. At the high level, it exploits a vision-language model (VLM) to predict task plans over the semantic keypoints. At the low level, it executes the plans with the help of a set of pre-built manipulation skills conditioned on the keypoints. Extensive simulation experiments show that CLASP outperforms state-of-the-art baseline methods on multiple tasks across diverse clothes types, demonstrating strong performance and generalization. Further experiments with a Franka dual-arm system on four distinct tasks—folding, flattening, hanging, and placing—confirm CLASP’s performance on real-life clothes manipulation.

Förderung

  • Ministry of Digital Development & Information, Singapore
  • NUS Research Scholarship

Zitieren

APA

Deng, Y., Tang, C., Yu, C., Li, L., & Hsu, D. (2026). CLASP: General-purpose clothes manipulation with semantic keypoints. The International Journal of Robotics Research. https://doi.org/10.1177/02783649261478649

Vancouver

Deng Y, Tang C, Yu C, Li L, Hsu D. CLASP: General-purpose clothes manipulation with semantic keypoints. The International Journal of Robotics Research. 2026. doi:10.1177/02783649261478649

BibTeX
@article{Deng2026,
  author = {Deng, Yuhong and Tang, Chao and Yu, Cunjun and Li, Linfeng and Hsu, David},
  title = {CLASP: General-purpose clothes manipulation with semantic keypoints},
  journal = {The International Journal of Robotics Research},
  year = {2026},
  doi = {10.1177/02783649261478649}
}
Kostenlos starten →