EUVIMEDEUVIMED entdecken
Crossref

An Integrated Framework of Lateral and Longitudinal Behavior Decision-Making for Autonomous Driving Using Reinforcement Learning

Haoyuan Ni, Guizhen Yu, Peng Chen, Bin Zhou, Yaping Liao, Han Li

IEEE Transactions on Vehicular Technology · 2024-07 · 73 (7) · 9706-9720

DOI: 10.1109/tvt.2024.3377288 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Vehicular Technology, 2024-07. Verfasst von Haoyuan Ni und 5 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 55 Literaturangaben. Gefördert von: National Key Technologies R&D Program of China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Lateral lane-changing and longitudinal car-following behavior decision-making is crucial for the implementation of autonomous driving (AD) in complex and dynamic traffic environment. Reinforcement learning (RL) has been increasingly applied to these behaviors due to its powerful environmental adaptability. However, typical RL-based research focused solely on one directional decision-making or output discrete actions in both lateral and longitudinal directions, which is not sufficiently flexible for AD. In view of the close interaction between lane-changing and car-following tasks, this study proposed an integrated framework to realize coupled decision-making using RL. Specifically, double deep Q-network (DDQN) was used to make the lateral lane change command decision-making, and twin delay deep deterministic policy gradient (TD3) used to make longitudinal car-following acceleration decision-making. The integration of DDQN and TD3 was deployed to tackle the problem of discrete-continuous hybrid action space in RL. The lateral decision-making was integrated into the actor-critic network for longitudinal decision-making to generate accurate acceleration in lane-changing or lane-keeping conditions. A series of simulation experiments were conducted in typical two-lane straight driving scenarios, validating the feasibility and applicability of the proposed integrated framework. The results reveal that the RL-based coupled decision-making helps enhance the implementation of AD.

Förderung

  • National Key Technologies R&D Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Ni, H., Yu, G., Chen, P., Zhou, B., Liao, Y., & Li, H. (2024). An Integrated Framework of Lateral and Longitudinal Behavior Decision-Making for Autonomous Driving Using Reinforcement Learning. IEEE Transactions on Vehicular Technology, 73(7), 9706-9720. https://doi.org/10.1109/tvt.2024.3377288

Vancouver

Ni H, Yu G, Chen P, Zhou B, Liao Y, Li H. An Integrated Framework of Lateral and Longitudinal Behavior Decision-Making for Autonomous Driving Using Reinforcement Learning. IEEE Transactions on Vehicular Technology. 2024;73(7):9706-9720. doi:10.1109/tvt.2024.3377288

BibTeX
@article{Ni2024,
  author = {Ni, Haoyuan and Yu, Guizhen and Chen, Peng and Zhou, Bin and Liao, Yaping and Li, Han},
  title = {An Integrated Framework of Lateral and Longitudinal Behavior Decision-Making for Autonomous Driving Using Reinforcement Learning},
  journal = {IEEE Transactions on Vehicular Technology},
  year = {2024},
  volume = {73},
  number = {7},
  pages = {9706--9720},
  doi = {10.1109/tvt.2024.3377288}
}
Kostenlos starten →