EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Vision-force-fused curriculum learning for robotic contact-rich assembly tasks

Piaopiao Jin, Yinjie Lin, Yaoxian Song, Tiefeng Li, Wei Yang

Frontiers in Neurorobotics · 06.10.2023 · 17

DOI: 10.3389/fnbot.2023.1280773 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Neurorobotics, online erschienen am 06.10.2023. Verfasst von Piaopiao Jin und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Engineering Mechanics, Center for X-Mechanics, Zhejiang University, Hangzhou, China. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Contact-rich robotic manipulation tasks such as assembly are widely studied due to their close relevance with social and manufacturing industries. Although the task is highly related to vision and force, current methods lack a unified mechanism to effectively fuse the two sensors. We consider coordinating multimodality from perception to control and propose a vision-force curriculum policy learning scheme to effectively fuse the features and generate policy. Experiments in simulations indicate the priorities of our method, which could insert pegs with 0.1 mm clearance. Furthermore, the system is generalizable to various initial configurations and unseen shapes, and it can be robustly transferred from simulation to reality without fine-tuning, showing the effectiveness and generalization of our proposed method. The experiment videos and code will be available at https://sites.google.com/view/vf-assembly .

Schlagwörter

Stichwörter der Autor:innen

contact-rich manipulationcurriculum learningmultimodal perceptionrobotic assembly tasksensor fusion

Autor:innen und Institutionen

  • Department of Engineering Mechanics, Center for X-Mechanics, Zhejiang University, Hangzhou, China.
  • Hikvision Digital Technology Company, Ltd., Hangzhou, Zhejiang, China.

Zitieren

APA

Jin, P., Lin, Y., Song, Y., Li, T., & Yang, W. (2023). Vision-force-fused curriculum learning for robotic contact-rich assembly tasks. Frontiers in Neurorobotics, 17. https://doi.org/10.3389/fnbot.2023.1280773

Vancouver

Jin P, Lin Y, Song Y, Li T, Yang W. Vision-force-fused curriculum learning for robotic contact-rich assembly tasks. Frontiers in Neurorobotics. 2023;17. doi:10.3389/fnbot.2023.1280773

BibTeX
@article{Jin2023,
  author = {Jin, Piaopiao and Lin, Yinjie and Song, Yaoxian and Li, Tiefeng and Yang, Wei},
  title = {Vision-force-fused curriculum learning for robotic contact-rich assembly tasks},
  journal = {Frontiers in Neurorobotics},
  year = {2023},
  volume = {17},
  doi = {10.3389/fnbot.2023.1280773}
}
Kostenlos starten →