Cooperative Decision-Making for Mixed Traffic at an Unsignalized Intersection Based on Multi-Agent Reinforcement Learning
Applied Sciences · 17.04.2023 · 13 (8) · 5018
DOI: 10.3390/app13085018 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 17.04.2023. Verfasst von Huanbiao Zhuang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key-Area Research and Development Program of Guangdong Province.
Abstract (Originalsprache)
Despite rapid advances in vehicle intelligence and connectivity, there is still a significant period in mixed traffic where connected, automated vehicles and human-driven vehicles coexist. The behavioral uncertainty of human-driven vehicles makes decision-making a challenging task in an unsignalized intersection scenario. In this paper, a decentralized multi-agent proximal policy optimization (MAPPO) based on an attention representations algorithm (Attn-MAPPO) was developed to make joint decisions at an intersection to avoid collisions and cross the intersection effectively. To implement this framework, by exploiting the shared information, the system was modeled as a model-free, fully cooperative, multi-agent system. The vehicle employed an attention module to extract the most valuable information from its neighbors. Based on the observation and traffic rules, a joint policy was identified to work more cooperatively based on the trajectory prediction of all the vehicles. To facilitate the collaboration between the vehicles, a weighted reward assignment scheme was proposed to focus more on the vehicles approaching intersections. The results presented the advantages of the Attn-MAPPO framework and validated the effectiveness of the designed reward function. Ultimately, the comparative experiments were conducted to demonstrate that the proposed approach was more adaptive and generalized than the heuristic rule-based model, which revealed its great potential for reinforcement learning in the decision-making of autonomous driving.
Förderung
- Key-Area Research and Development Program of Guangdong Province
Zitieren
APA
Zhuang, H., Lei, C., Chen, Y., & Tan, X. (2023). Cooperative Decision-Making for Mixed Traffic at an Unsignalized Intersection Based on Multi-Agent Reinforcement Learning. Applied Sciences, 13(8), 5018. https://doi.org/10.3390/app13085018
Vancouver
Zhuang H, Lei C, Chen Y, Tan X. Cooperative Decision-Making for Mixed Traffic at an Unsignalized Intersection Based on Multi-Agent Reinforcement Learning. Applied Sciences. 2023;13(8):5018. doi:10.3390/app13085018
BibTeX
@article{Zhuang2023,
author = {Zhuang, Huanbiao and Lei, Chaofan and Chen, Yuanhang and Tan, Xiaojun},
title = {Cooperative Decision-Making for Mixed Traffic at an Unsignalized Intersection Based on Multi-Agent Reinforcement Learning},
journal = {Applied Sciences},
year = {2023},
volume = {13},
number = {8},
pages = {5018},
doi = {10.3390/app13085018}
}
EUVIMED