Research on Deep Reinforcement Learning Control Algorithm for Active Suspension Considering Uncertain Time Delay
Sensors · 12.09.2023 · 23 (18) · 7827
DOI: 10.3390/s23187827 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 12.09.2023. Verfasst von Yang Wang und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100811, China. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: The National Key Research and Development Program of China, China Postdoctoral Science Foundation Funded Project.
Abstract (Originalsprache)
The uncertain delay characteristic of actuators is a critical factor that affects the control effectiveness of the active suspension system. Therefore, it is crucial to develop a control algorithm that takes into account this uncertain delay in order to ensure stable control performance. This study presents a novel active suspension control algorithm based on deep reinforcement learning (DRL) that specifically addresses the issue of uncertain delay. In this approach, a twin-delayed deep deterministic policy gradient (TD3) algorithm with system delay is employed to obtain the optimal control policy by iteratively solving the dynamic model of the active suspension system, considering the delay. Furthermore, three different operating conditions were designed for simulation to evaluate the control performance: deterministic delay, semi-regular delay, and uncertain delay. The experimental results demonstrate that the proposed algorithm achieves excellent control performance under various operating conditions. Compared to passive suspension, the optimization of body vertical acceleration is improved by more than 30%, and the proposed algorithm effectively mitigates body vibration in the low frequency range. It consistently maintains a more than 30% improvement in ride comfort optimization even under the most severe operating conditions and at different speeds, demonstrating the algorithm’s potential for practical application.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Mechanical Engineering, Beijing Institute of Technology, Beijing 100811, China.
- State Key Laboratory of Automotive Simulation and Control, Jilin University, Changchun 130025, China.
Förderung
- The National Key Research and Development Program of China
- China Postdoctoral Science Foundation Funded Project
Zitieren
APA
Wang, Y., Wang, C., Zhao, S., & Guo, K. (2023). Research on Deep Reinforcement Learning Control Algorithm for Active Suspension Considering Uncertain Time Delay. Sensors, 23(18), 7827. https://doi.org/10.3390/s23187827
Vancouver
Wang Y, Wang C, Zhao S, Guo K. Research on Deep Reinforcement Learning Control Algorithm for Active Suspension Considering Uncertain Time Delay. Sensors. 2023;23(18):7827. doi:10.3390/s23187827
BibTeX
@article{Wang2023,
author = {Wang, Yang and Wang, Cheng and Zhao, Shijie and Guo, Konghui},
title = {Research on Deep Reinforcement Learning Control Algorithm for Active Suspension Considering Uncertain Time Delay},
journal = {Sensors},
year = {2023},
volume = {23},
number = {18},
pages = {7827},
doi = {10.3390/s23187827}
}
EUVIMED