Actor–critic learning based PID control for robotic manipulators
Applied Soft Computing · 2024-01 · 151 · 111153
DOI: 10.1016/j.asoc.2023.111153 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Soft Computing, 2024-01. Verfasst von Hamed Rahimi Nohooji und 2 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 67 Literaturangaben.
Abstract (Originalsprache)
In this paper, we propose a reinforcement learning structure for auto-tuning PID gains by solving an optimal tracking control problem for robot manipulators. Capitalizing on the actor-critic framework implemented by neural networks, we achieve optimal tracking performance, estimating unknown system dynamics simultaneously. The critic network is used to approximate the cost function, which serves as an indicator of control performance. With feedback from the critic, the actor network learns time-varying PID gains over time to optimize control input, thereby steering the sys-tem toward optimal performance. Furthermore, we utilize Lyapunov’s direct method to demonstrate the stability of the closed-loop system. This approach provides an analytical procedure for a stable robot manipulator system to systematically adjust PID gains, bypassing the ad-hoc and painstaking process. The resultant actor-critic PID-like control exhibits stable adaptive and learning capabilities while maintaining a simple structure and inexpensive online computational demands. Numerical simulations underscore the effectiveness and advantages of the proposed actor-critic neural network PID control.
Zitieren
APA
Nohooji, H. R., Zaraki, A., & Voos, H. (2024). Actor–critic learning based PID control for robotic manipulators. Applied Soft Computing, 151, 111153. https://doi.org/10.1016/j.asoc.2023.111153
Vancouver
Nohooji HR, Zaraki A, Voos H. Actor–critic learning based PID control for robotic manipulators. Applied Soft Computing. 2024;151:111153. doi:10.1016/j.asoc.2023.111153
BibTeX
@article{Nohooji2024,
author = {Nohooji, Hamed Rahimi and Zaraki, Abolfazl and Voos, Holger},
title = {Actor–critic learning based PID control for robotic manipulators},
journal = {Applied Soft Computing},
year = {2024},
volume = {151},
pages = {111153},
doi = {10.1016/j.asoc.2023.111153}
}
EUVIMED