Improved Deep Reinforcement Learning for Intelligent Traffic Signal Control Using ECA_LSTM Network
Sustainability · 13.09.2023 · 15 (18) · 13668
DOI: 10.3390/su151813668 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sustainability, online erschienen am 13.09.2023. Verfasst von Wenjiao Zai und 1 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Reinforcement learning is one of the most widely used methods for traffic signal control, but the method experiences issues with state information explosion, inadequate adaptability to special scenarios, and low security. Therefore, this paper proposes a traffic signal control method based on the efficient channel attention mechanism (ECA-NET), long short-term memory (LSTM), and double Dueling deep Q-network (D3QN), which is EL_D3QN. Firstly, the ECA-NET and LSTM module are included in order to lessen the state space’s design complexity, improve the model’s robustness, and adapt to various emergent scenarios. As a result, the cumulative reward is improved by 27.9%, and the average queue length, average waiting time, and CO2 emissions are decreased by 15.8%, 22.6%, and 4.1%, respectively. Next, the dynamic phase interval tgap is employed to enable the model to handle more traffic conditions. Its cumulative reward is increased by 34.2%, and the average queue length, average waiting time, and CO2 emissions are reduced by 19.8%, 30.1%, and 5.6%. Finally, experiments are carried out using various vehicle circumstances and unique scenarios. In a complex environment, EL_D3QN reduces the average queue length, average waiting time, and CO2 emissions by at least 13.2%, 20.2%, and 3.2% compared to the four existing methods. EL_D3QN also exhibits good generalization and control performance when exposed to the traffic scenarios of unequal stability and equal stability. Furthermore, even when dealing with unique events like a traffic surge, EL_D3QN maintains significant robustness.
Zitieren
APA
Zai, W., & Yang, D. (2023). Improved Deep Reinforcement Learning for Intelligent Traffic Signal Control Using ECA_LSTM Network. Sustainability, 15(18), 13668. https://doi.org/10.3390/su151813668
Vancouver
Zai W, Yang D. Improved Deep Reinforcement Learning for Intelligent Traffic Signal Control Using ECA_LSTM Network. Sustainability. 2023;15(18):13668. doi:10.3390/su151813668
BibTeX
@article{Zai2023,
author = {Zai, Wenjiao and Yang, Dan},
title = {Improved Deep Reinforcement Learning for Intelligent Traffic Signal Control Using ECA_LSTM Network},
journal = {Sustainability},
year = {2023},
volume = {15},
number = {18},
pages = {13668},
doi = {10.3390/su151813668}
}
EUVIMED