Pushing with Soft Robotic Arms via Deep Reinforcement Learning
Advanced Intelligent Systems · 2024-08 · 6 (8)
DOI: 10.1002/aisy.202300899 ↗Kurz gefasst
Fachartikel in der Zeitschrift Advanced Intelligent Systems, online erschienen am 08.07.2024. Verfasst von Carlo Alessi und 4 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: H2020 Future and Emerging Technologies.
Abstract (Originalsprache)
Soft robots can adaptively interact with unstructured environments. However, nonlinear soft material properties challenge modeling and control. Learning‐based controllers that leverage efficient mechanical models are promising for solving complex interaction tasks. This article develops a closed‐loop pose/force controller for a dexterous soft manipulator enabling dynamic pushing tasks using deep reinforcement learning. Force tests investigate the mechanical properties of a soft robot module, resulting in orthogonal forces of N. Then, the policy is trained in simulation leveraging a dynamic Cosserat rod model of the soft robot. Domain randomization mitigate the sim‐to‐real gap while careful reward engineering induced pose and force control even without explicit force inputs. Despite the approximate simulation, the sim‐to‐real transfer achieved an average reaching distance of mm (), an average orientation error of rad () and applied pushing forces up to N. Such performance is reasonable for the intended assistive tasks of the manipulator. The experiments uncovered that the soft robot interacting with the environment exhibited torsional and counter‐balancing movements. Although not explicitly enforced, they emerged from the mechanical intelligence of the manipulator. The results demonstrate the potential of soft robotic manipulation via reinforcement learning.
Förderung
- H2020 Future and Emerging Technologies
Zitieren
APA
Alessi, C., Bianchi, D., Stano, G., Cianchetti, M., & Falotico, E. (2024). Pushing with Soft Robotic Arms via Deep Reinforcement Learning. Advanced Intelligent Systems, 6(8). https://doi.org/10.1002/aisy.202300899
Vancouver
Alessi C, Bianchi D, Stano G, Cianchetti M, Falotico E. Pushing with Soft Robotic Arms via Deep Reinforcement Learning. Advanced Intelligent Systems. 2024;6(8). doi:10.1002/aisy.202300899
BibTeX
@article{Alessi2024,
author = {Alessi, Carlo and Bianchi, Diego and Stano, Gianni and Cianchetti, Matteo and Falotico, Egidio},
title = {Pushing with Soft Robotic Arms via Deep Reinforcement Learning},
journal = {Advanced Intelligent Systems},
year = {2024},
volume = {6},
number = {8},
doi = {10.1002/aisy.202300899}
}
EUVIMED