Online PID Tuning Strategy for Hydraulic Servo Control Systems via SAC-Based Deep Reinforcement Learning
Machines · 29.05.2023 · 11 (6) · 593
DOI: 10.3390/machines11060593 ↗Kurz gefasst
Fachartikel in der Zeitschrift Machines, online erschienen am 29.05.2023. Verfasst von Jianhui He und 4 weiteren Autor:innen. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Proportional–integral–derivative (PID) control is the most common control technique used in hydraulic servo control systems. However, the nonlinearity and uncertainty of the hydraulic system make it challenging for PID control to achieve high-precision control. This paper proposes a novel control strategy that combines the soft actor-critic (SAC) reinforcement learning algorithm with the PID method to address this issue. The proposed control strategy consists of an upper-level controller based on the SAC algorithm and a lower-level controller based on the PID control method. The upper-level controller continuously tunes the control parameters of the lower-level controller based on the tracking error and system status. The lower-level controller performs real-time control for the hydraulic servo system with a control frequency 10 times higher than the upper controllers. Simulation experiments demonstrate that the proposed SAC-PID control strategy can effectively address disturbances and achieve high precision control for hydraulic servo control systems in uncertain working conditions compared with PID and fuzzy PID control methods. Therefore, the proposed control strategy offers a promising approach to improving the tracking performance of hydraulic servo systems.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
He, J., Su, S., Wang, H., Chen, F., & Yin, B. (2023). Online PID Tuning Strategy for Hydraulic Servo Control Systems via SAC-Based Deep Reinforcement Learning. Machines, 11(6), 593. https://doi.org/10.3390/machines11060593
Vancouver
He J, Su S, Wang H, Chen F, Yin B. Online PID Tuning Strategy for Hydraulic Servo Control Systems via SAC-Based Deep Reinforcement Learning. Machines. 2023;11(6):593. doi:10.3390/machines11060593
BibTeX
@article{He2023,
author = {He, Jianhui and Su, Shijie and Wang, Hairong and Chen, Fan and Yin, BaoJi},
title = {Online PID Tuning Strategy for Hydraulic Servo Control Systems via SAC-Based Deep Reinforcement Learning},
journal = {Machines},
year = {2023},
volume = {11},
number = {6},
pages = {593},
doi = {10.3390/machines11060593}
}
EUVIMED