Pri-DDQN: learning adaptive traffic signal control strategy through a hybrid agent
Complex & Intelligent Systems · 2025-01 · 11 (1)
DOI: 10.1007/s40747-024-01651-5 ↗Kurz gefasst
Fachartikel in der Zeitschrift Complex & Intelligent Systems, online erschienen am 18.11.2024. Verfasst von Yanliu Zheng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Chongqin, The science and technology innovation Program of Hunan Province.
Abstract (Originalsprache)
Adaptive traffic signal control is the core of the intelligent transportation system (ITS), which can effectively reduce the pressure on traffic congestion and improve travel efficiency. Methods based on deep Q-leaning network (DQN) have become the mainstream to solve single-intersection traffic signal control. However, most of them neglect the important difference of samples and the dependence of traffic states, and cannot quickly respond to randomly changing traffic flows. In this paper, we propose a new single-intersection traffic signal control method (Pri-DDQN) based on reinforcement learning and model the traffic environment as a reinforcement learning environment, and the agent chooses the best action to schedule the traffic flow at the intersection based on the real-time traffic states. With the goal of minimizing the waiting time and queue length at intersections, we use double DQN to train the agent, incorporate traffic state and reward into the loss function, and update the target network parameters asynchronously, to improve the agent’s learning ability. We try to use the power function to dynamically change the exploration rate to accelerate convergence. In addition, we introduce a priority-based dynamic experience replay mechanism to increase the sampling rate of important samples. The results show that Pri-DDQN achieves better performance, compared to the best baseline, it reduces the average queue length is reduced by 13.41%, and the average waiting time by 32.33% at the intersection.
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Chongqin
- The science and technology innovation Program of Hunan Province
Zitieren
APA
Zheng, Y., Luo, J., Gao, H., Zhou, Y., & Li, K. (2025). Pri-DDQN: learning adaptive traffic signal control strategy through a hybrid agent. Complex & Intelligent Systems, 11(1). https://doi.org/10.1007/s40747-024-01651-5
Vancouver
Zheng Y, Luo J, Gao H, Zhou Y, Li K. Pri-DDQN: learning adaptive traffic signal control strategy through a hybrid agent. Complex & Intelligent Systems. 2025;11(1). doi:10.1007/s40747-024-01651-5
BibTeX
@article{Zheng2025,
author = {Zheng, Yanliu and Luo, Juan and Gao, Han and Zhou, Yi and Li, Keqin},
title = {Pri-DDQN: learning adaptive traffic signal control strategy through a hybrid agent},
journal = {Complex & Intelligent Systems},
year = {2025},
volume = {11},
number = {1},
doi = {10.1007/s40747-024-01651-5}
}
EUVIMED