Adaptive MPC path-tracking controller based on reinforcement learning and preview-based PID controller
Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering · 2025-10 · 239 (12) · 5380-5396
DOI: 10.1177/09544070241287965 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, online erschienen am 17.10.2024. Verfasst von Kun Feng und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 21 Literaturangaben. Gefördert von: Chongqing Postgraduate Research and Innovation Program, Supported by the Science and Technology Research Program of Chongqing Municipal Education Commission, National Natural Science Foundation of China.
Abstract (Originalsprache)
Path-tracking control is a crucial process for autonomous vehicles, ensuring that the vehicle drives safely along the reference path, and the suitable controller parameters ensure the accuracy and stability of this process. To enhance the adaptability of traditional path-tracking controller parameters, this paper proposes an adaptive model predictive control (MPC) controller based on a preview-based PID controller and deep deterministic policy gradient (DDPG) algorithm to achieve adaptive tuning of the controller parameters. Starting with the design of the dynamics tracking error model of the vehicle and the MPC controller. Based on the actor-critic reinforcement learning architecture, the DDPG agent is designed to tune the prediction horizon and weight matrix of the MPC controller. A preview-based PID controller is proposed to improve the efficiency and stability of reinforcement learning and compensate for the error in vehicle modeling. The improved algorithm performance is verified through the simulation scenarios of high-speed lane changing and accelerated overtaking scenarios constructed by MATLAB/Simulink. The results show that the improved algorithm significantly improves the adaptive ability of the traditional MPC controller to time-varying conditions and achieves higher tracking accuracy and stability.
Förderung
- Chongqing Postgraduate Research and Innovation Program
- Supported by the Science and Technology Research Program of Chongqing Municipal Education Commission
- National Natural Science Foundation of China
Zitieren
APA
Feng, K., Li, X., & Li, W. (2025). Adaptive MPC path-tracking controller based on reinforcement learning and preview-based PID controller. Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, 239(12), 5380-5396. https://doi.org/10.1177/09544070241287965
Vancouver
Feng K, Li X, Li W. Adaptive MPC path-tracking controller based on reinforcement learning and preview-based PID controller. Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering. 2025;239(12):5380-5396. doi:10.1177/09544070241287965
BibTeX
@article{Feng2025,
author = {Feng, Kun and Li, Xu and Li, Wenli},
title = {Adaptive MPC path-tracking controller based on reinforcement learning and preview-based PID controller},
journal = {Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering},
year = {2025},
volume = {239},
number = {12},
pages = {5380--5396},
doi = {10.1177/09544070241287965}
}
EUVIMED