EUVIMEDEUVIMED entdecken
Crossref

Deep Multi-Agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic

Dong Chen, Mohammad R. Hajidavalloo, Zhaojian Li, Kaian Chen, Yongqiang Wang, Longsheng Jiang, Yue Wang

IEEE Transactions on Intelligent Transportation Systems · 2023-11 · 24 (11) · 11623-11638

DOI: 10.1109/tits.2023.3285442 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2023-11. Verfasst von Dong Chen und 6 weiteren Autor:innen. Die Arbeit wurde bisher 245-mal zitiert (Crossref) und nennt 71 Literaturangaben. Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

On-ramp merging is a challenging task for autonomous vehicles (AVs), especially in mixed traffic where AVs coexist with human-driven vehicles (HDVs). In this paper, we formulate the mixed-traffic highway on-ramp merging problem as a multi-agent reinforcement learning (MARL) problem, where the AVs (on both merge lane and through lane) collaboratively learn a policy to adapt to HDVs to maximize the traffic throughput. We develop an efficient and scalable MARL framework that can be used in dynamic traffic where the communication topology could be time-varying. Parameter sharing and local rewards are exploited to foster inter-agent cooperation while achieving great scalability. An action masking scheme is employed to improve learning efficiency by filtering out invalid/unsafe actions at each step. In addition, a novel priority-based safety supervisor is developed to significantly reduce collision rate and greatly expedite the training process. A gym-like simulation environment is developed and open-sourced with three different levels of traffic densities. We exploit curriculum learning to efficiently learn harder tasks from trained models under simpler settings. Comprehensive experimental results show the proposed MARL framework consistently outperforms several state-of-the-art benchmarks.

Förderung

  • National Science Foundation

Zitieren

APA

Chen, D., Hajidavalloo, M. R., Li, Z., Chen, K., Wang, Y., Jiang, L., & Wang, Y. (2023). Deep Multi-Agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic. IEEE Transactions on Intelligent Transportation Systems, 24(11), 11623-11638. https://doi.org/10.1109/tits.2023.3285442

Vancouver

Chen D, Hajidavalloo MR, Li Z, Chen K, Wang Y, Jiang L, et al. Deep Multi-Agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic. IEEE Transactions on Intelligent Transportation Systems. 2023;24(11):11623-11638. doi:10.1109/tits.2023.3285442

BibTeX
@article{Chen2023,
  author = {Chen, Dong and Hajidavalloo, Mohammad R. and Li, Zhaojian and Chen, Kaian and Wang, Yongqiang and Jiang, Longsheng and Wang, Yue},
  title = {Deep Multi-Agent Reinforcement Learning for Highway On-Ramp Merging in Mixed Traffic},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2023},
  volume = {24},
  number = {11},
  pages = {11623--11638},
  doi = {10.1109/tits.2023.3285442}
}
Kostenlos starten →