Model-Based Predictive Control and Reinforcement Learning for Planning Vehicle-Parking Trajectories for Vertical Parking Spaces
Sensors · 11.08.2023 · 23 (16) · 7124
DOI: 10.3390/s23167124 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 11.08.2023. Verfasst von Junren Shi und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation, Chongqing University of Posts and Telecommunications, Chongqing 400065, China. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: The National Key Research and Development Program of China, Chongqing University of Posts and Telecommunications, Chongqing Postdoctoral Research Special Funding Project.
Abstract (Originalsprache)
This paper proposes a vehicle-parking trajectory planning method that addresses the issues of a long trajectory planning time and difficult training convergence during automatic parking. The process involves two stages: finding a parking space and parking planning. The first stage uses model predictive control (MPC) for trajectory tracking from the initial position of the vehicle to the starting point of the parking operation. The second stage employs the proximal policy optimization (PPO) algorithm to transform the parking behavior into a reinforcement learning process. A four-dimensional reward function is set to evaluate the strategy based on a formal reward, guiding the adjustment of neural network parameters and reducing the exploration of invalid actions. Finally, a simulation environment is built for the parking scene, and a network framework is designed. The proposed method is compared with the deep deterministic policy gradient and double-delay deep deterministic policy gradient algorithms in the same scene. Results confirm that the MPC controller accurately performs trajectory-tracking control with minimal steering wheel angle changes and smooth, continuous movement. The PPO-based reinforcement learning method achieves shorter learning times, totaling only 30% and 37.5% of the deep deterministic policy gradient (DDPG) and twin-delayed deep deterministic policy gradient (TD3), and the number of iterations to reach convergence for the PPO algorithm with the introduction of the four-dimensional evaluation metrics is 75% and 68% shorter compared to the DDPG and TD3 algorithms, respectively. This study demonstrates the effectiveness of the proposed method in addressing a slow convergence and long training times in parking trajectory planning, improving parking timeliness.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Automation, Chongqing University of Posts and Telecommunications, Chongqing 400065, China.
- School of Computer Science and Technology, Chongqing University of Posts and Telecommunications, Chongqing 400065, China.
ORCID-Profile: Junren Shi, Kexin Li
Förderung
- The National Key Research and Development Program of China
- Chongqing University of Posts and Telecommunications
- Chongqing Postdoctoral Research Special Funding Project
- school-level research projects
Zitieren
APA
Shi, J., Li, K., Piao, C., Gao, J., & Chen, L. (2023). Model-Based Predictive Control and Reinforcement Learning for Planning Vehicle-Parking Trajectories for Vertical Parking Spaces. Sensors, 23(16), 7124. https://doi.org/10.3390/s23167124
Vancouver
Shi J, Li K, Piao C, Gao J, Chen L. Model-Based Predictive Control and Reinforcement Learning for Planning Vehicle-Parking Trajectories for Vertical Parking Spaces. Sensors. 2023;23(16):7124. doi:10.3390/s23167124
BibTeX
@article{Shi2023,
author = {Shi, Junren and Li, Kexin and Piao, Changhao and Gao, Jun and Chen, Lizhi},
title = {Model-Based Predictive Control and Reinforcement Learning for Planning Vehicle-Parking Trajectories for Vertical Parking Spaces},
journal = {Sensors},
year = {2023},
volume = {23},
number = {16},
pages = {7124},
doi = {10.3390/s23167124}
}
EUVIMED