Robust Dynamic Bus Control: a Distributional Multi-Agent Reinforcement Learning Approach
IEEE Transactions on Intelligent Transportation Systems · 2023-04 · 24 (4) · 4075-4088
DOI: 10.1109/tits.2022.3229527 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2023-04. Verfasst von Jiawei Wang und 1 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: Fonds de Recherche du Québec-Société et Culture (FRQSC) under the NSFC-FRQSC Research Program on Smart Cities and Big Data, Canada Foundation for Innovation (CFI) John R. Evans Leaders Fund.
Abstract (Originalsprache)
The bus system is a critical component of sustainable urban transportation. However, the operation of a bus fleet is unstable in nature, and bus bunching has become a common phenomenon that undermines the efficiency and reliability of bus systems. Recently research has demonstrated the promising application of multi-agent reinforcement learning (MARL) to achieve efficient vehicle holding control to avoid bus bunching. However, existing studies essentially overlook the robustness issue resulting from perturbations and anomalies in a transit system, which is of utmost importance when transferring the models for real-world deployment/application. In this study, we integrate implicit quantile network and meta-learning to develop a distributional MARL framework—IQNC-M—to learn continuous control. The proposed IQNC-M framework achieves efficient and reliable control decisions through better handling various uncertainties in real-time transit operations. Specifically, we introduce an interpretable meta-learning module to incorporate global information into the distributional MARL framework, which is an effective solution to circumvent the credit assignment issue in the transit system. In addition, we design a specific learning procedure to train each agent within the framework to pursue a robust control policy. We develop simulation environments based on real-world bus services and passenger demand data and evaluate the proposed framework against both traditional holding control models and state-of-the-art MARL models. Our results show that the proposed IQNC-M framework can effectively handle the general perturbations and various extreme events, such as traffic state perturbations and demand surges, thus improving both efficiency and reliability of the transit system.
Förderung
- Fonds de Recherche du Québec-Société et Culture (FRQSC) under the NSFC-FRQSC Research Program on Smart Cities and Big Data
- Canada Foundation for Innovation (CFI) John R. Evans Leaders Fund
Zitieren
APA
Wang, J., & Sun, L. (2023). Robust Dynamic Bus Control: a Distributional Multi-Agent Reinforcement Learning Approach. IEEE Transactions on Intelligent Transportation Systems, 24(4), 4075-4088. https://doi.org/10.1109/tits.2022.3229527
Vancouver
Wang J, Sun L. Robust Dynamic Bus Control: a Distributional Multi-Agent Reinforcement Learning Approach. IEEE Transactions on Intelligent Transportation Systems. 2023;24(4):4075-4088. doi:10.1109/tits.2022.3229527
BibTeX
@article{Wang2023,
author = {Wang, Jiawei and Sun, Lijun},
title = {Robust Dynamic Bus Control: a Distributional Multi-Agent Reinforcement Learning Approach},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2023},
volume = {24},
number = {4},
pages = {4075--4088},
doi = {10.1109/tits.2022.3229527}
}
EUVIMED