EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Optimization Control of Adaptive Traffic Signal with Deep Reinforcement Learning

Kerang Cao, Liwei Wang, Shuo Zhang, Lini Duan, Guimin Jiang, Stefano Sfarra, Hai Zhang, Hoekyung Jung

Electronics · 02.01.2024 · 13 (1) · 198

DOI: 10.3390/electronics13010198 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 02.01.2024. Verfasst von Kerang Cao und 7 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: MSIT (Ministry of Science and ICT), Republic of Korea, 2023 Liaoning Provincial Education Department’s Basic Research General Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The optimization and control of traffic signals is very important for logistics transportation. It not only improves the operational efficiency and safety of road traffic, but also conforms to the direction of the intelligent, green, and sustainable development of modern cities. In order to improve the optimization effect of traffic signal control, this paper proposes a traffic signal optimization method based on deep reinforcement learning and Simulation of Urban Mobility (SUMO) software for urban traffic scenarios. The intersection training scenario was established using SUMO micro traffic simulation software, and the maximum vehicle queue length and vehicle queue time were selected as performance evaluation indicators. In order to be more relevant to the real environment, the experiment uses Weibull distribution to simulate vehicle generation. Since deep reinforcement learning takes into account both perceptual and decision-making capabilities, this study proposes a traffic signal optimization control model based on the deep reinforcement learning Deep Q Network (DQN) algorithm by considering the realism and complexity of traffic intersections, and first uses the DQN algorithm to train the model in a training scenario. After that, the G-DQN (Grouping-DQN) algorithm is proposed to address the problems that the definition of states in existing studies cannot accurately represent the traffic states and the slow convergence of neural networks. Finally, the performance of the G-DQN algorithm model was compared with the original DQN algorithm model and Advantage Actor-Critic (A2C) algorithm model. The experimental results show that the improved algorithm increased the main indicators in all aspects.

Förderung

  • MSIT (Ministry of Science and ICT), Republic of Korea
  • 2023 Liaoning Provincial Education Department’s Basic Research General Project

Zitieren

APA

Cao, K., Wang, L., Zhang, S., Duan, L., Jiang, G., Sfarra, S., Zhang, H., & Jung, H. (2024). Optimization Control of Adaptive Traffic Signal with Deep Reinforcement Learning. Electronics, 13(1), 198. https://doi.org/10.3390/electronics13010198

Vancouver

Cao K, Wang L, Zhang S, Duan L, Jiang G, Sfarra S, et al. Optimization Control of Adaptive Traffic Signal with Deep Reinforcement Learning. Electronics. 2024;13(1):198. doi:10.3390/electronics13010198

BibTeX
@article{Cao2024,
  author = {Cao, Kerang and Wang, Liwei and Zhang, Shuo and Duan, Lini and Jiang, Guimin and Sfarra, Stefano and Zhang, Hai and Jung, Hoekyung},
  title = {Optimization Control of Adaptive Traffic Signal with Deep Reinforcement Learning},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {1},
  pages = {198},
  doi = {10.3390/electronics13010198}
}
Infokarte | EUVIMED

Artikeldaten derzeit nicht verfügbar.

Recherche