EUVIMEDEUVIMED entdecken
Crossref

Bayesian Critique-Tune-based Reinforcement Learning With Adaptive Pressure for Multi-Intersection Traffic Signal Control

Wenchang Duan, Zhenguo Gao, Jiwan He, Jinguo Xian

IEEE Transactions on Intelligent Transportation Systems · 2025-10 · 26 (10) · 14968-14983

DOI: 10.1109/tits.2025.3581858 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-10. Verfasst von Wenchang Duan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Adaptive traffic signal control (ATSC) is a critical component of intelligent transportation systems, with the capability to significantly alleviate urban traffic congestion. Reinforcement learning (RL)-based methods have demonstrated promising performance in achieving ATSC. However, due to the excessive trust of RL policies and the ineffectiveness of traffic movement representation, the existing methods are prone to making unreasonable policies. Such policies originate from instability in convergence or entrapment in local optima during training, and are reflected in poor decision-making performance. Therefore, this paper proposes a novel Bayesian Critique-Tune-based reinforcement learning with Adaptive Pressure (BCT-APLight) for multi-intersection signal control. In BCT-APLight, the Critique-Tune (CT) framework, a two-layer Bayesian structure is designed to refine the excessive trust of RL policies. Specifically, the Bayesian inference-based Critique Layer (CL) provides effective evaluations of the credibility of policies. When these evaluations are negative, the Bayesian decision-based Tune Layer (TL) fine-tunes the policies by minimizing the posterior risks. Meanwhile, an attention-based Adaptive Pressure (AP) mechanism is designed to effectively weight the effect of upstream lanes, thereby enhancing the rationality of traffic movement representation within the network. Extensive experiments conducted with a simulator over multi-intersection demonstrate that BCT-APLight is superior to other state-of-the-art (SOTA) methods on nine real-world datasets. Specifically, BCT-APLight decreases average waiting time (AWT) by $\boldsymbol {12.92\%}$ over all tested datasets on average. Codes are open-sourced.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Duan, W., Gao, Z., He, J., & Xian, J. (2025). Bayesian Critique-Tune-based Reinforcement Learning With Adaptive Pressure for Multi-Intersection Traffic Signal Control. IEEE Transactions on Intelligent Transportation Systems, 26(10), 14968-14983. https://doi.org/10.1109/tits.2025.3581858

Vancouver

Duan W, Gao Z, He J, Xian J. Bayesian Critique-Tune-based Reinforcement Learning With Adaptive Pressure for Multi-Intersection Traffic Signal Control. IEEE Transactions on Intelligent Transportation Systems. 2025;26(10):14968-14983. doi:10.1109/tits.2025.3581858

BibTeX
@article{Duan2025,
  author = {Duan, Wenchang and Gao, Zhenguo and He, Jiwan and Xian, Jinguo},
  title = {Bayesian Critique-Tune-based Reinforcement Learning With Adaptive Pressure for Multi-Intersection Traffic Signal Control},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2025},
  volume = {26},
  number = {10},
  pages = {14968--14983},
  doi = {10.1109/tits.2025.3581858}
}
Kostenlos starten →