EUVIMEDEUVIMED entdecken
Crossref

Free Your Hands: Human-Demonstration-Free Diffusion Policy Adaptation for Robotic Manipulation

Ge Yuan, Ming Yang, Jing Zhang, Jianxin Pang, Dong Xu

IEEE Transactions on Circuits and Systems for Video Technology · 2026-08 · 36 (8) · 12586-12600

DOI: 10.1109/tcsvt.2026.3686290 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-08. Verfasst von Ge Yuan und 4 weiteren Autor:innen. Die Arbeit nennt 106 Literaturangaben. Gefördert von: Research Grants Council (RGC) of Hong Kong, SAR, under the General Research Fund, Collaborative Research Fund, NSFC/RGC Collaborative Research Scheme.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Diffusion-based policies demonstrate remarkable capabilities in generating robust and precise actions for embodied tasks. However, when adapting to a new environment with visual domain gap such as lighting variation, object appearance change, different background, and unseen distractors, these methods require a substantial amount of human demonstrations gathered through teleoperation. This data collection process incurs significant costs in terms of both time and financial resources. To this end, we introduce FreeHand, which enables cross-environment adaptation without requiring additional teleoperated demonstrations, freeing human hands from the time-consuming data collection process. Specifically, we find that a well-trained diffusion policy network struggles to adapt to new environments due to distribution mismatches at both the visual and policy levels. Simply aligning domains at the visual level is insufficient, as even subtle visual changes in the environment can lead to severe action failures. Therefore, we propose a two-level alignment scheme. The visual-level alignment is achieved through adversarial training between the visual features from old and new environments. For the policy-level alignment, we introduce a novel noise-aware adversarial learning strategy for the diffusion policy. We validate our approach through comprehensive cross-domain adaptation experiments under three settings: Sim2Sim (PushT, CALVIN, RoboTwin), Real2Sim (SimplerEnv), and Real2Real (real-world robotic deployment). Our method demonstrates significant improvement with minimal additional parameter overhead, showcasing its effectiveness and efficiency.

Förderung

  • Research Grants Council (RGC) of Hong Kong, SAR, under the General Research Fund
  • Collaborative Research Fund
  • NSFC/RGC Collaborative Research Scheme
  • HKU Shanghai Intelligent Computing Research Center
  • JC STEM Lab of Multimedia and Machine Learning funded by The Hong Kong Jockey Club Charities Trust

Zitieren

APA

Yuan, G., Yang, M., Zhang, J., Pang, J., & Xu, D. (2026). Free Your Hands: Human-Demonstration-Free Diffusion Policy Adaptation for Robotic Manipulation. IEEE Transactions on Circuits and Systems for Video Technology, 36(8), 12586-12600. https://doi.org/10.1109/tcsvt.2026.3686290

Vancouver

Yuan G, Yang M, Zhang J, Pang J, Xu D. Free Your Hands: Human-Demonstration-Free Diffusion Policy Adaptation for Robotic Manipulation. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(8):12586-12600. doi:10.1109/tcsvt.2026.3686290

BibTeX
@article{Yuan2026,
  author = {Yuan, Ge and Yang, Ming and Zhang, Jing and Pang, Jianxin and Xu, Dong},
  title = {Free Your Hands: Human-Demonstration-Free Diffusion Policy Adaptation for Robotic Manipulation},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2026},
  volume = {36},
  number = {8},
  pages = {12586--12600},
  doi = {10.1109/tcsvt.2026.3686290}
}
Kostenlos starten →