EUVIMEDEUVIMED entdecken
Crossref

Integration of Planning and Deep Reinforcement Learning in Speed and Lane Change Decision-Making for Highway Autonomous Driving

Sunan Zhang, Weichao Zhuang, Bingbing Li, Ke Li, Tianyu Xia, Bo Hu

IEEE Transactions on Transportation Electrification · 2025-02 · 11 (1) · 521-535

DOI: 10.1109/tte.2024.3393293 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Transportation Electrification, 2025-02. Verfasst von Sunan Zhang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: Natural Science Foundation of Chongqing, Science and Technology Research Program of Chongqing Municipal Education Commission, Chongqing Banan District Scientific Research Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The intricate interactions with other road users and the diversity of traffic environments create a challenging decision-making task for autonomous driving systems. While offline learning solutions are renowned for their high execution efficiency and the ability to approximate the optimal policy across the entire state space, they are often unsafe and fragile when encountering untrained states. Conversely, online planning methods possess the capacity to thoroughly assess how current decisions influence future outcomes online, and therefore, have better generalization. Nevertheless, these approaches face difficulties in terms of execution efficiency and are susceptible to becoming stuck in locally optimal solutions. In this context, this article proposes an integrated planning and learning (IPL) algorithm based on the reinforcement learning (RL) framework for speed and lane change decision-making on highways. Specifically, at each decision time step, this method utilizes the offline learned model to guide an online Monte Carlo Tree Search (MCTS) algorithm for heuristic search, aiming to formulate a forward-looking policy. The experimental results show that the IPL algorithm performs better generalization when faced with unknown scenarios, and its asymptotic performance is better than other benchmark algorithms. In addition, in contrast to the MCTS-based online planning method, the IPL algorithm enhances execution efficiency and comes closer to achieving global optimality.

Förderung

  • Natural Science Foundation of Chongqing
  • Science and Technology Research Program of Chongqing Municipal Education Commission
  • Chongqing Banan District Scientific Research Project

Zitieren

APA

Zhang, S., Zhuang, W., Li, B., Li, K., Xia, T., & Hu, B. (2025). Integration of Planning and Deep Reinforcement Learning in Speed and Lane Change Decision-Making for Highway Autonomous Driving. IEEE Transactions on Transportation Electrification, 11(1), 521-535. https://doi.org/10.1109/tte.2024.3393293

Vancouver

Zhang S, Zhuang W, Li B, Li K, Xia T, Hu B. Integration of Planning and Deep Reinforcement Learning in Speed and Lane Change Decision-Making for Highway Autonomous Driving. IEEE Transactions on Transportation Electrification. 2025;11(1):521-535. doi:10.1109/tte.2024.3393293

BibTeX
@article{Zhang2025,
  author = {Zhang, Sunan and Zhuang, Weichao and Li, Bingbing and Li, Ke and Xia, Tianyu and Hu, Bo},
  title = {Integration of Planning and Deep Reinforcement Learning in Speed and Lane Change Decision-Making for Highway Autonomous Driving},
  journal = {IEEE Transactions on Transportation Electrification},
  year = {2025},
  volume = {11},
  number = {1},
  pages = {521--535},
  doi = {10.1109/tte.2024.3393293}
}
Kostenlos starten →