Bayesian Critique-Tune-based Reinforcement Learning With Adaptive Pressure for Multi-Intersection Traffic Signal Control
IEEE Transactions on Intelligent Transportation Systems · 2025-10 · 26 (10) · 14968-14983
DOI: 10.1109/tits.2025.3581858 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-10. Verfasst von Wenchang Duan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Adaptive traffic signal control (ATSC) is a critical component of intelligent transportation systems, with the capability to significantly alleviate urban traffic congestion. Reinforcement learning (RL)-based methods have demonstrated promising performance in achieving ATSC. However, due to the excessive trust of RL policies and the ineffectiveness of traffic movement representation, the existing methods are prone to making unreasonable policies. Such policies originate from instability in convergence or entrapment in local optima during training, and are reflected in poor decision-making performance. Therefore, this paper proposes a novel Bayesian Critique-Tune-based reinforcement learning with Adaptive Pressure (BCT-APLight) for multi-intersection signal control. In BCT-APLight, the Critique-Tune (CT) framework, a two-layer Bayesian structure is designed to refine the excessive trust of RL policies. Specifically, the Bayesian inference-based Critique Layer (CL) provides effective evaluations of the credibility of policies. When these evaluations are negative, the Bayesian decision-based Tune Layer (TL) fine-tunes the policies by minimizing the posterior risks. Meanwhile, an attention-based Adaptive Pressure (AP) mechanism is designed to effectively weight the effect of upstream lanes, thereby enhancing the rationality of traffic movement representation within the network. Extensive experiments conducted with a simulator over multi-intersection demonstrate that BCT-APLight is superior to other state-of-the-art (SOTA) methods on nine real-world datasets. Specifically, BCT-APLight decreases average waiting time (AWT) by $\boldsymbol {12.92\%}$ over all tested datasets on average. Codes are open-sourced.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Duan, W., Gao, Z., He, J., & Xian, J. (2025). Bayesian Critique-Tune-based Reinforcement Learning With Adaptive Pressure for Multi-Intersection Traffic Signal Control. IEEE Transactions on Intelligent Transportation Systems, 26(10), 14968-14983. https://doi.org/10.1109/tits.2025.3581858
Vancouver
Duan W, Gao Z, He J, Xian J. Bayesian Critique-Tune-based Reinforcement Learning With Adaptive Pressure for Multi-Intersection Traffic Signal Control. IEEE Transactions on Intelligent Transportation Systems. 2025;26(10):14968-14983. doi:10.1109/tits.2025.3581858
BibTeX
@article{Duan2025,
author = {Duan, Wenchang and Gao, Zhenguo and He, Jiwan and Xian, Jinguo},
title = {Bayesian Critique-Tune-based Reinforcement Learning With Adaptive Pressure for Multi-Intersection Traffic Signal Control},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2025},
volume = {26},
number = {10},
pages = {14968--14983},
doi = {10.1109/tits.2025.3581858}
}
EUVIMED