Vehicle-Level Fairness-Oriented Constrained Multi-Agent Reinforcement Learning for Adaptive Traffic Signal Control
IEEE Transactions on Intelligent Transportation Systems · 2025-04 · 26 (4) · 4878-4890
DOI: 10.1109/tits.2025.3544223 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2025-04. Verfasst von Wanting Liu und 8 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Shandong Provincial Natural Science Foundation, China.
Abstract (Originalsprache)
Multi-agent Reinforcement Learning (MARL) has shown considerable promise in enhancing the efficiency of adaptive traffic signal control (ATSC) systems. However, existing MARL approaches primarily focus on optimizing overall traffic flow, often overlooking the issue of fairness in vehicle waiting times. Considering that there is no need to strive for the ultimate fairness, this paper models the ATSC problem as a Constrained Partially Observable Markov Game (CPOMG), where fairness is modeled as a constraint on the maximum waiting time of vehicles on lanes of intersections instead of a reward term that pursues maximization. CPOMG aims to find a cooperative control policy with optimal traffic efficiency within the constrained solution space by multiple agents. On this basis, this paper proposes a new centralized training and decentralized execution cooperative MARL method, i.e., vehicle-level fairness multi-agent proximity policy optimization (VF-MAPPO). VF-MAPPO leverages a centralized trained global Critic Network to estimate the average vehicle traffic efficiency and vehicle maximum waiting time, and an Actor Network shared by all intersections for decentralized execution, which converts the optimization problem with constraints to an unconstrained optimization objective through the Lagrange multiplier method and adopts proximity policy optimization during training. Additionally, VF-MAPPO incorporates spatial-temporal graph attention in the Critic network to efficiently extract state representations in multi-intersection environments. We qualitatively analyzed the monotonic improvement guarantee of VF-MAPPO. Extensive experimental validation across two real-world and one synthetic scenarios substantiates that VF-MAPPO enhances vehicle-level fairness and maintains average traffic efficiency, surpassing state-of-the-art methods.
Förderung
- National Natural Science Foundation of China
- Shandong Provincial Natural Science Foundation, China
Zitieren
APA
Liu, W., Zhang, C., Fang, W., Zhou, K., Li, Y., Zhan, F., Wang, Q., Xue, W., & Chen, R. (2025). Vehicle-Level Fairness-Oriented Constrained Multi-Agent Reinforcement Learning for Adaptive Traffic Signal Control. IEEE Transactions on Intelligent Transportation Systems, 26(4), 4878-4890. https://doi.org/10.1109/tits.2025.3544223
Vancouver
Liu W, Zhang C, Fang W, Zhou K, Li Y, Zhan F, et al. Vehicle-Level Fairness-Oriented Constrained Multi-Agent Reinforcement Learning for Adaptive Traffic Signal Control. IEEE Transactions on Intelligent Transportation Systems. 2025;26(4):4878-4890. doi:10.1109/tits.2025.3544223
BibTeX
@article{Liu2025,
author = {Liu, Wanting and Zhang, Chengwei and Fang, Wanqing and Zhou, Kailing and Li, Yihong and Zhan, Furui and Wang, Qi and Xue, Wanli and Chen, Rong},
title = {Vehicle-Level Fairness-Oriented Constrained Multi-Agent Reinforcement Learning for Adaptive Traffic Signal Control},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2025},
volume = {26},
number = {4},
pages = {4878--4890},
doi = {10.1109/tits.2025.3544223}
}
EUVIMED