A Novel Actor—Critic Motor Reinforcement Learning for Continuum Soft Robots
Robotics · 09.10.2023 · 12 (5) · 141
DOI: 10.3390/robotics12050141 ↗Kurz gefasst
Fachartikel in der Zeitschrift Robotics, online erschienen am 09.10.2023. Verfasst von Luis Pantoja-Garcia und 3 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Reinforcement learning (RL) is explored for motor control of a novel pneumatic-driven soft robot modeled after continuum media with a varying density. This model complies with closed-form Lagrangian dynamics, which fulfills the fundamental structural property of passivity, among others. Then, the question arises of how to synthesize a passivity-based RL model to control the unknown continuum soft robot dynamics to exploit its input–output energy properties advantageously throughout a reward-based neural network controller. Thus, we propose a continuous-time Actor–Critic scheme for tracking tasks of the continuum 3D soft robot subject to Lipschitz disturbances. A reward-based temporal difference leads to learning with a novel discontinuous adaptive mechanism of Critic neural weights. Finally, the reward and integral of the Bellman error approximation reinforce the adaptive mechanism of Actor neural weights. Closed-loop stability is guaranteed in the sense of Lyapunov, which leads to local exponential convergence of tracking errors based on integral sliding modes. Notably, it is assumed that dynamics are unknown, yet the control is continuous and robust. A representative simulation study shows the effectiveness of our proposal for tracking tasks.
Zitieren
APA
Pantoja-Garcia, L., Parra-Vega, V., Garcia-Rodriguez, R., & Vázquez-García, C. E. (2023). A Novel Actor—Critic Motor Reinforcement Learning for Continuum Soft Robots. Robotics, 12(5), 141. https://doi.org/10.3390/robotics12050141
Vancouver
Pantoja-Garcia L, Parra-Vega V, Garcia-Rodriguez R, Vázquez-García CE. A Novel Actor—Critic Motor Reinforcement Learning for Continuum Soft Robots. Robotics. 2023;12(5):141. doi:10.3390/robotics12050141
BibTeX
@article{PantojaGarcia2023,
author = {Pantoja-Garcia, Luis and Parra-Vega, Vicente and Garcia-Rodriguez, Rodolfo and Vázquez-García, Carlos Ernesto},
title = {A Novel Actor—Critic Motor Reinforcement Learning for Continuum Soft Robots},
journal = {Robotics},
year = {2023},
volume = {12},
number = {5},
pages = {141},
doi = {10.3390/robotics12050141}
}
EUVIMED