EUVIMEDEUVIMED entdecken
Crossref

Vehicle-Level Fairness-Oriented Constrained Multi-Agent Reinforcement Learning for Adaptive Traffic Signal Control

Wanting Liu, Chengwei Zhang, Wanqing Fang, Kailing Zhou, Yihong Li, Furui Zhan, Qi Wang, Wanli Xue, Rong Chen

IEEE Transactions on Intelligent Transportation Systems · 2025-04 · 26 (4) · 4878-4890

DOI: 10.1109/tits.2025.3544223 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-04. Verfasst von Wanting Liu und 8 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Shandong Provincial Natural Science Foundation, China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-agent Reinforcement Learning (MARL) has shown considerable promise in enhancing the efficiency of adaptive traffic signal control (ATSC) systems. However, existing MARL approaches primarily focus on optimizing overall traffic flow, often overlooking the issue of fairness in vehicle waiting times. Considering that there is no need to strive for the ultimate fairness, this paper models the ATSC problem as a Constrained Partially Observable Markov Game (CPOMG), where fairness is modeled as a constraint on the maximum waiting time of vehicles on lanes of intersections instead of a reward term that pursues maximization. CPOMG aims to find a cooperative control policy with optimal traffic efficiency within the constrained solution space by multiple agents. On this basis, this paper proposes a new centralized training and decentralized execution cooperative MARL method, i.e., vehicle-level fairness multi-agent proximity policy optimization (VF-MAPPO). VF-MAPPO leverages a centralized trained global Critic Network to estimate the average vehicle traffic efficiency and vehicle maximum waiting time, and an Actor Network shared by all intersections for decentralized execution, which converts the optimization problem with constraints to an unconstrained optimization objective through the Lagrange multiplier method and adopts proximity policy optimization during training. Additionally, VF-MAPPO incorporates spatial-temporal graph attention in the Critic network to efficiently extract state representations in multi-intersection environments. We qualitatively analyzed the monotonic improvement guarantee of VF-MAPPO. Extensive experimental validation across two real-world and one synthetic scenarios substantiates that VF-MAPPO enhances vehicle-level fairness and maintains average traffic efficiency, surpassing state-of-the-art methods.

Förderung

  • National Natural Science Foundation of China
  • Shandong Provincial Natural Science Foundation, China

Zitieren

APA

Liu, W., Zhang, C., Fang, W., Zhou, K., Li, Y., Zhan, F., Wang, Q., Xue, W., & Chen, R. (2025). Vehicle-Level Fairness-Oriented Constrained Multi-Agent Reinforcement Learning for Adaptive Traffic Signal Control. IEEE Transactions on Intelligent Transportation Systems, 26(4), 4878-4890. https://doi.org/10.1109/tits.2025.3544223

Vancouver

Liu W, Zhang C, Fang W, Zhou K, Li Y, Zhan F, et al. Vehicle-Level Fairness-Oriented Constrained Multi-Agent Reinforcement Learning for Adaptive Traffic Signal Control. IEEE Transactions on Intelligent Transportation Systems. 2025;26(4):4878-4890. doi:10.1109/tits.2025.3544223

BibTeX
@article{Liu2025,
  author = {Liu, Wanting and Zhang, Chengwei and Fang, Wanqing and Zhou, Kailing and Li, Yihong and Zhan, Furui and Wang, Qi and Xue, Wanli and Chen, Rong},
  title = {Vehicle-Level Fairness-Oriented Constrained Multi-Agent Reinforcement Learning for Adaptive Traffic Signal Control},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2025},
  volume = {26},
  number = {4},
  pages = {4878--4890},
  doi = {10.1109/tits.2025.3544223}
}
Kostenlos starten →