EUVIMEDEUVIMED entdecken
Crossref

Actor–critic learning based PID control for robotic manipulators

Hamed Rahimi Nohooji, Abolfazl Zaraki, Holger Voos

Applied Soft Computing · 2024-01 · 151 · 111153

DOI: 10.1016/j.asoc.2023.111153 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Soft Computing, 2024-01. Verfasst von Hamed Rahimi Nohooji und 2 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 67 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this paper, we propose a reinforcement learning structure for auto-tuning PID gains by solving an optimal tracking control problem for robot manipulators. Capitalizing on the actor-critic framework implemented by neural networks, we achieve optimal tracking performance, estimating unknown system dynamics simultaneously. The critic network is used to approximate the cost function, which serves as an indicator of control performance. With feedback from the critic, the actor network learns time-varying PID gains over time to optimize control input, thereby steering the sys-tem toward optimal performance. Furthermore, we utilize Lyapunov’s direct method to demonstrate the stability of the closed-loop system. This approach provides an analytical procedure for a stable robot manipulator system to systematically adjust PID gains, bypassing the ad-hoc and painstaking process. The resultant actor-critic PID-like control exhibits stable adaptive and learning capabilities while maintaining a simple structure and inexpensive online computational demands. Numerical simulations underscore the effectiveness and advantages of the proposed actor-critic neural network PID control.

Zitieren

APA

Nohooji, H. R., Zaraki, A., & Voos, H. (2024). Actor–critic learning based PID control for robotic manipulators. Applied Soft Computing, 151, 111153. https://doi.org/10.1016/j.asoc.2023.111153

Vancouver

Nohooji HR, Zaraki A, Voos H. Actor–critic learning based PID control for robotic manipulators. Applied Soft Computing. 2024;151:111153. doi:10.1016/j.asoc.2023.111153

BibTeX
@article{Nohooji2024,
  author = {Nohooji, Hamed Rahimi and Zaraki, Abolfazl and Voos, Holger},
  title = {Actor–critic learning based PID control for robotic manipulators},
  journal = {Applied Soft Computing},
  year = {2024},
  volume = {151},
  pages = {111153},
  doi = {10.1016/j.asoc.2023.111153}
}
Kostenlos starten →