Human–Machine Shared Control for Steer-by-Wire Vehicles Using Improved Reinforcement Learning-Based MPC
IEEE Transactions on Intelligent Transportation Systems · 2025-08 · 26 (8) · 12688-12700
DOI: 10.1109/tits.2025.3556596 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-08. Verfasst von Han Zhang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 37 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Jiangsu Province, Jiangsu Outstanding Youth Fund Project.
Abstract (Originalsprache)
To enhance the trajectory tracking capability of steer-by-wire (SBW) vehicles while reducing driver’s workload, a human-machine shared control (HMSC) strategy using improved reinforcement learning-based model predictive control (RL-MPC) is proposed. In this paper, two main contributions have been made: 1) for driver loop, a variable steering ratio (VSR) strategy applied to SBW system is designed based on an improved fuzzy controller, whose parameters are optimized through simulated annealing (SA) algorithm; 2) for intelligent control system loop, an improved RL-MPC method is proposed to realize the high precision steering tracking control for autonomous vehicles (AVs), in which MPC and deep deterministic policy gradient (DDPG) are deeply integrated to combine their short-term optimization ability and long-term value estimation capability. Moreover, to shorten the time of overall training and ensure that the optimal control strategy can be explored, the DDPG agent is pretrained before the parallel training of RL-MPC. CarSim-MATLAB/Simulink co-simulation results show that in the whole tracking process, the lateral position error and yaw angle error of the vehicle are significantly reduced, indicating that the tracking accuracy is greatly improved. Meanwhile, the steering wheel angle and speed are also reduced, which means that the driver will spend less energy during the steering process.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Jiangsu Province
- Jiangsu Outstanding Youth Fund Project
- Jiangsu Key Research and Development Plan
- Postgraduate Research and Practice Innovation Program of Nanjing University of Aeronautics and Astronautics
Zitieren
APA
Zhang, H., Liu, Y., Zhao, W., Hu, C., & Zhao, J. (2025). Human–Machine Shared Control for Steer-by-Wire Vehicles Using Improved Reinforcement Learning-Based MPC. IEEE Transactions on Intelligent Transportation Systems, 26(8), 12688-12700. https://doi.org/10.1109/tits.2025.3556596
Vancouver
Zhang H, Liu Y, Zhao W, Hu C, Zhao J. Human–Machine Shared Control for Steer-by-Wire Vehicles Using Improved Reinforcement Learning-Based MPC. IEEE Transactions on Intelligent Transportation Systems. 2025;26(8):12688-12700. doi:10.1109/tits.2025.3556596
BibTeX
@article{Zhang2025,
author = {Zhang, Han and Liu, Yuhan and Zhao, Wanzhong and Hu, Chuan and Zhao, Jing},
title = {Human–Machine Shared Control for Steer-by-Wire Vehicles Using Improved Reinforcement Learning-Based MPC},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2025},
volume = {26},
number = {8},
pages = {12688--12700},
doi = {10.1109/tits.2025.3556596}
}
EUVIMED