EUVIMEDEUVIMED entdecken
Crossref

A Multi-Agent Reinforcement Learning Approach for Safe and Efficient Behavior Planning of Connected Autonomous Vehicles

Songyang Han, Shanglin Zhou, Jiangwei Wang, Lynn Pepin, Caiwen Ding, Jie Fu, Fei Miao

IEEE Transactions on Intelligent Transportation Systems · 2024-05 · 25 (5) · 3654-3670

DOI: 10.1109/tits.2023.3336670 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2024-05. Verfasst von Songyang Han und 6 weiteren Autor:innen. Die Arbeit wurde bisher 49-mal zitiert (Crossref) und nennt 78 Literaturangaben. Gefördert von: NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The recent advancements in wireless technology enable connected autonomous vehicles (CAVs) to gather information about their environment by vehicle-to-vehicle (V2V) communication. In this work, we design an information-sharing-based multi-agent reinforcement learning (MARL) framework for CAVs, to take advantage of the extra information when making decisions to improve traffic efficiency and safety. The safe actor-critic algorithm we propose has two new techniques: the truncated $\mathcal {Q}$ -function and safe action mapping. The truncated $\mathcal {Q}$ -function utilizes the shared information from neighboring CAVs such that the joint state and action spaces of the $\mathcal {Q}$ -function do not grow in our algorithm for a large-scale CAV system. We prove the bound of the approximation error between the truncated- $\mathcal {Q}$ and global $Q$ -functions. The safe action mapping provides a provable safety guarantee for both the training and execution based on control barrier functions. Using the CARLA simulator for experiments, we show that our approach improves the CAV system’s efficiency in terms of average velocity and comfort under different CAV ratios and different traffic densities. We also show that our approach avoids the execution of unsafe actions and always maintains a safe distance from other vehicles. We construct an obstacle-at-corner scenario to show that the shared vision can help CAVs to observe obstacles earlier and take action to avoid traffic jams. The experiment video is on https://songyanghan.github.io/cavmarl/ .

Förderung

  • NSF

Zitieren

APA

Han, S., Zhou, S., Wang, J., Pepin, L., Ding, C., Fu, J., & Miao, F. (2024). A Multi-Agent Reinforcement Learning Approach for Safe and Efficient Behavior Planning of Connected Autonomous Vehicles. IEEE Transactions on Intelligent Transportation Systems, 25(5), 3654-3670. https://doi.org/10.1109/tits.2023.3336670

Vancouver

Han S, Zhou S, Wang J, Pepin L, Ding C, Fu J, et al. A Multi-Agent Reinforcement Learning Approach for Safe and Efficient Behavior Planning of Connected Autonomous Vehicles. IEEE Transactions on Intelligent Transportation Systems. 2024;25(5):3654-3670. doi:10.1109/tits.2023.3336670

BibTeX
@article{Han2024,
  author = {Han, Songyang and Zhou, Shanglin and Wang, Jiangwei and Pepin, Lynn and Ding, Caiwen and Fu, Jie and Miao, Fei},
  title = {A Multi-Agent Reinforcement Learning Approach for Safe and Efficient Behavior Planning of Connected Autonomous Vehicles},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2024},
  volume = {25},
  number = {5},
  pages = {3654--3670},
  doi = {10.1109/tits.2023.3336670}
}
Kostenlos starten →