Integration of Planning and Deep Reinforcement Learning in Speed and Lane Change Decision-Making for Highway Autonomous Driving
IEEE Transactions on Transportation Electrification · 2025-02 · 11 (1) · 521-535
DOI: 10.1109/tte.2024.3393293 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Transportation Electrification, 2025-02. Verfasst von Sunan Zhang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: Natural Science Foundation of Chongqing, Science and Technology Research Program of Chongqing Municipal Education Commission, Chongqing Banan District Scientific Research Project.
Abstract (Originalsprache)
The intricate interactions with other road users and the diversity of traffic environments create a challenging decision-making task for autonomous driving systems. While offline learning solutions are renowned for their high execution efficiency and the ability to approximate the optimal policy across the entire state space, they are often unsafe and fragile when encountering untrained states. Conversely, online planning methods possess the capacity to thoroughly assess how current decisions influence future outcomes online, and therefore, have better generalization. Nevertheless, these approaches face difficulties in terms of execution efficiency and are susceptible to becoming stuck in locally optimal solutions. In this context, this article proposes an integrated planning and learning (IPL) algorithm based on the reinforcement learning (RL) framework for speed and lane change decision-making on highways. Specifically, at each decision time step, this method utilizes the offline learned model to guide an online Monte Carlo Tree Search (MCTS) algorithm for heuristic search, aiming to formulate a forward-looking policy. The experimental results show that the IPL algorithm performs better generalization when faced with unknown scenarios, and its asymptotic performance is better than other benchmark algorithms. In addition, in contrast to the MCTS-based online planning method, the IPL algorithm enhances execution efficiency and comes closer to achieving global optimality.
Förderung
- Natural Science Foundation of Chongqing
- Science and Technology Research Program of Chongqing Municipal Education Commission
- Chongqing Banan District Scientific Research Project
Zitieren
APA
Zhang, S., Zhuang, W., Li, B., Li, K., Xia, T., & Hu, B. (2025). Integration of Planning and Deep Reinforcement Learning in Speed and Lane Change Decision-Making for Highway Autonomous Driving. IEEE Transactions on Transportation Electrification, 11(1), 521-535. https://doi.org/10.1109/tte.2024.3393293
Vancouver
Zhang S, Zhuang W, Li B, Li K, Xia T, Hu B. Integration of Planning and Deep Reinforcement Learning in Speed and Lane Change Decision-Making for Highway Autonomous Driving. IEEE Transactions on Transportation Electrification. 2025;11(1):521-535. doi:10.1109/tte.2024.3393293
BibTeX
@article{Zhang2025,
author = {Zhang, Sunan and Zhuang, Weichao and Li, Bingbing and Li, Ke and Xia, Tianyu and Hu, Bo},
title = {Integration of Planning and Deep Reinforcement Learning in Speed and Lane Change Decision-Making for Highway Autonomous Driving},
journal = {IEEE Transactions on Transportation Electrification},
year = {2025},
volume = {11},
number = {1},
pages = {521--535},
doi = {10.1109/tte.2024.3393293}
}
EUVIMED