EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Novel Actor—Critic Motor Reinforcement Learning for Continuum Soft Robots

Luis Pantoja-Garcia, Vicente Parra-Vega, Rodolfo Garcia-Rodriguez, Carlos Ernesto Vázquez-García

Robotics · 09.10.2023 · 12 (5) · 141

DOI: 10.3390/robotics12050141 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Robotics, online erschienen am 09.10.2023. Verfasst von Luis Pantoja-Garcia und 3 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reinforcement learning (RL) is explored for motor control of a novel pneumatic-driven soft robot modeled after continuum media with a varying density. This model complies with closed-form Lagrangian dynamics, which fulfills the fundamental structural property of passivity, among others. Then, the question arises of how to synthesize a passivity-based RL model to control the unknown continuum soft robot dynamics to exploit its input–output energy properties advantageously throughout a reward-based neural network controller. Thus, we propose a continuous-time Actor–Critic scheme for tracking tasks of the continuum 3D soft robot subject to Lipschitz disturbances. A reward-based temporal difference leads to learning with a novel discontinuous adaptive mechanism of Critic neural weights. Finally, the reward and integral of the Bellman error approximation reinforce the adaptive mechanism of Actor neural weights. Closed-loop stability is guaranteed in the sense of Lyapunov, which leads to local exponential convergence of tracking errors based on integral sliding modes. Notably, it is assumed that dynamics are unknown, yet the control is continuous and robust. A representative simulation study shows the effectiveness of our proposal for tracking tasks.

Zitieren

APA

Pantoja-Garcia, L., Parra-Vega, V., Garcia-Rodriguez, R., & Vázquez-García, C. E. (2023). A Novel Actor—Critic Motor Reinforcement Learning for Continuum Soft Robots. Robotics, 12(5), 141. https://doi.org/10.3390/robotics12050141

Vancouver

Pantoja-Garcia L, Parra-Vega V, Garcia-Rodriguez R, Vázquez-García CE. A Novel Actor—Critic Motor Reinforcement Learning for Continuum Soft Robots. Robotics. 2023;12(5):141. doi:10.3390/robotics12050141

BibTeX
@article{PantojaGarcia2023,
  author = {Pantoja-Garcia, Luis and Parra-Vega, Vicente and Garcia-Rodriguez, Rodolfo and Vázquez-García, Carlos Ernesto},
  title = {A Novel Actor—Critic Motor Reinforcement Learning for Continuum Soft Robots},
  journal = {Robotics},
  year = {2023},
  volume = {12},
  number = {5},
  pages = {141},
  doi = {10.3390/robotics12050141}
}
Kostenlos starten →