EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Improving traffic signal control operations using proximal policy optimization

Liben Huang, Xiaohui Qu

IET Intelligent Transport Systems · 2023-03 · 17 (3) · 592-605

DOI: 10.1049/itr2.12286 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Intelligent Transport Systems, online erschienen am 17.10.2022. Verfasst von Liben Huang und 1 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Existing traffic signal control systems present many limitations including fixed signal timing schemes, insufficient efficiency and flexibility, and difficulty in adapting to the changing traffic flows. In recent years, the development of deep reinforcement learning (RL) has shown great research potential and application prospects. This paper proposes an intersection signal control method based on the proximal policy optimization (PPO) method. Specifically, this paper uses the value vector representation method of traffic characteristics to encode the traffic state and then feeds the state encoding into the long short‐term memory (LSTM) network to obtain the signal phase output. Finally, to obtain the optimal signal control strategy, the PPO algorithm is utilized to train the neural network and adjust the signal phase. The proposed algorithm is benchmarked against other classic RL and adaptive signal control schemes in an experimental environment based on the traffic simulation software simulation of urban mobility (SUMO). Experimental results showed that the proposed algorithm greatly improves traffic efficiency. Specifically, the mean velocity of the vehicles increases by 45.09%, and the mean occupancy rate of each lane, the length of the longest jams during each step, and the mean halting duration dropped by 21.38%, 25.86%, and 12.94%, respectively.

Zitieren

APA

Huang, L., & Qu, X. (2023). Improving traffic signal control operations using proximal policy optimization. IET Intelligent Transport Systems, 17(3), 592-605. https://doi.org/10.1049/itr2.12286

Vancouver

Huang L, Qu X. Improving traffic signal control operations using proximal policy optimization. IET Intelligent Transport Systems. 2023;17(3):592-605. doi:10.1049/itr2.12286

BibTeX
@article{Huang2023,
  author = {Huang, Liben and Qu, Xiaohui},
  title = {Improving traffic signal control operations using proximal policy optimization},
  journal = {IET Intelligent Transport Systems},
  year = {2023},
  volume = {17},
  number = {3},
  pages = {592--605},
  doi = {10.1049/itr2.12286}
}
Kostenlos starten →