Intersection decision making for autonomous vehicles based on improved PPO algorithm
IET Intelligent Transport Systems · 2024-12 · 18 (S1) · 2921-2938
DOI: 10.1049/itr2.12593 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Intelligent Transport Systems, online erschienen am 27.11.2024. Verfasst von Dong Guo und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
The deployment of autonomous vehicles (AVs) in complex urban environments faces numerous challenges, especially at intersections where they coexist with human‐driven vehicles (HVs), resulting in increased safety risks. In response, this study proposes an improved control strategy based on the Proximal Policy Optimization (PPO) algorithm, specifically designed for hybrid intersections, known as MSA‐PPO. First, the Self‐Attention Mechanism (SAM) is introduced into the algorithmic framework to quickly identify the surrounding vehicles with a greater impact on the ego vehicle from different perspectives, accelerating data processing and improving decision quality. Second, an invalid action masking mechanism is adopted to reduce the action space, ensuring actions are only selected from feasible sets, thereby enhancing decision efficiency. Finally, comparative and ablation experiments in hybrid intersection simulation environments of varying complexity are conducted to validate the algorithm's effectiveness. The results show that the improved algorithm converges faster, achieves higher decision accuracy, and demonstrates the highest speed levels during driving compared to other baseline algorithms.
Zitieren
APA
Guo, D., He, S., & Ji, S. (2024). Intersection decision making for autonomous vehicles based on improved PPO algorithm. IET Intelligent Transport Systems, 18(S1), 2921-2938. https://doi.org/10.1049/itr2.12593
Vancouver
Guo D, He S, Ji S. Intersection decision making for autonomous vehicles based on improved PPO algorithm. IET Intelligent Transport Systems. 2024;18(S1):2921-2938. doi:10.1049/itr2.12593
BibTeX
@article{Guo2024,
author = {Guo, Dong and He, Shoulin and Ji, Shouwen},
title = {Intersection decision making for autonomous vehicles based on improved PPO algorithm},
journal = {IET Intelligent Transport Systems},
year = {2024},
volume = {18},
number = {S1},
pages = {2921--2938},
doi = {10.1049/itr2.12593}
}
EUVIMED