EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

SoC-VRP: A Deep-Reinforcement-Learning-Based Vehicle Route Planning Mechanism for Service-Oriented Cooperative ITS

Boyuan Hou, Kailong Zhang, Zu Gong, Qiugang Li, Junle Zhou, Jiahao Zhang, Arnaud de La Fortelle

Electronics · 2023-10-10 · 12 (20) · 4191

DOI: 10.3390/electronics12204191 ↗

At a glance

Journal article in Electronics, published online on 2023-10-10. Written by Boyuan Hou and 6 co-authors. Cited 17 times so far (Crossref); 52 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, Shaanxi Provincial Science and Technology Project.

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

With the rapid development of emerging information technology and its increasing integration with transportation systems, the Intelligent Transportation System (ITS) is entering a new phase, called Cooperative ITS (C-ITS). It offers promising solutions to numerous challenges in traditional transportation systems, among which the Vehicle Routing Problem (VRP) is a significant concern addressed in this work. Considering the varying urgency levels of different vehicles and their different traveling constraints in the Service-oriented Cooperative ITS (SoC-ITS) framework studied in our previous research, the Service-oriented Cooperative Vehicle Routing Problem (SoC-VRP) is firstly analyzed, in which cooperative planning and vehicle urgency degrees are two vital factors. After examining the characteristics of both VRP and SoC-VRP, a Deep Reinforcement Learning (DRL)-based prioritized route planning mechanism is proposed. Specifically, we establish a deep reinforcement learning model with Rainbow DQN and devise a prioritized successive decision-making route planning method for SoC-ITS, where vehicle urgency degrees are mapped to three priorities: High for emergency vehicles, Medium for shuttle buses, and Low for the rest. All proposed models and methods are implemented, trained using various scenarios on typical road networks, and verified with SUMO-based scenes. Experimental results demonstrate the effectiveness of this hybrid prioritized route planning mechanism.

Funding

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities
  • Shaanxi Provincial Science and Technology Project

Cite

APA

Hou, B., Zhang, K., Gong, Z., Li, Q., Zhou, J., Zhang, J., & Fortelle, A. D. L. (2023). SoC-VRP: A Deep-Reinforcement-Learning-Based Vehicle Route Planning Mechanism for Service-Oriented Cooperative ITS. Electronics, 12(20), 4191. https://doi.org/10.3390/electronics12204191

Vancouver

Hou B, Zhang K, Gong Z, Li Q, Zhou J, Zhang J, et al. SoC-VRP: A Deep-Reinforcement-Learning-Based Vehicle Route Planning Mechanism for Service-Oriented Cooperative ITS. Electronics. 2023;12(20):4191. doi:10.3390/electronics12204191

BibTeX
@article{Hou2023,
  author = {Hou, Boyuan and Zhang, Kailong and Gong, Zu and Li, Qiugang and Zhou, Junle and Zhang, Jiahao and Fortelle, Arnaud de La},
  title = {SoC-VRP: A Deep-Reinforcement-Learning-Based Vehicle Route Planning Mechanism for Service-Oriented Cooperative ITS},
  journal = {Electronics},
  year = {2023},
  volume = {12},
  number = {20},
  pages = {4191},
  doi = {10.3390/electronics12204191}
}
Start for free →