EUVIMEDEUVIMED entdecken
Crossref

Robust Dynamic Bus Control: a Distributional Multi-Agent Reinforcement Learning Approach

Jiawei Wang, Lijun Sun

IEEE Transactions on Intelligent Transportation Systems · 2023-04 · 24 (4) · 4075-4088

DOI: 10.1109/tits.2022.3229527 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2023-04. Verfasst von Jiawei Wang und 1 weiteren Autor:innen. Die Arbeit wurde bisher 30-mal zitiert (Crossref) und nennt 44 Literaturangaben. Gefördert von: Fonds de Recherche du Québec-Société et Culture (FRQSC) under the NSFC-FRQSC Research Program on Smart Cities and Big Data, Canada Foundation for Innovation (CFI) John R. Evans Leaders Fund.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The bus system is a critical component of sustainable urban transportation. However, the operation of a bus fleet is unstable in nature, and bus bunching has become a common phenomenon that undermines the efficiency and reliability of bus systems. Recently research has demonstrated the promising application of multi-agent reinforcement learning (MARL) to achieve efficient vehicle holding control to avoid bus bunching. However, existing studies essentially overlook the robustness issue resulting from perturbations and anomalies in a transit system, which is of utmost importance when transferring the models for real-world deployment/application. In this study, we integrate implicit quantile network and meta-learning to develop a distributional MARL framework—IQNC-M—to learn continuous control. The proposed IQNC-M framework achieves efficient and reliable control decisions through better handling various uncertainties in real-time transit operations. Specifically, we introduce an interpretable meta-learning module to incorporate global information into the distributional MARL framework, which is an effective solution to circumvent the credit assignment issue in the transit system. In addition, we design a specific learning procedure to train each agent within the framework to pursue a robust control policy. We develop simulation environments based on real-world bus services and passenger demand data and evaluate the proposed framework against both traditional holding control models and state-of-the-art MARL models. Our results show that the proposed IQNC-M framework can effectively handle the general perturbations and various extreme events, such as traffic state perturbations and demand surges, thus improving both efficiency and reliability of the transit system.

Förderung

  • Fonds de Recherche du Québec-Société et Culture (FRQSC) under the NSFC-FRQSC Research Program on Smart Cities and Big Data
  • Canada Foundation for Innovation (CFI) John R. Evans Leaders Fund

Zitieren

APA

Wang, J., & Sun, L. (2023). Robust Dynamic Bus Control: a Distributional Multi-Agent Reinforcement Learning Approach. IEEE Transactions on Intelligent Transportation Systems, 24(4), 4075-4088. https://doi.org/10.1109/tits.2022.3229527

Vancouver

Wang J, Sun L. Robust Dynamic Bus Control: a Distributional Multi-Agent Reinforcement Learning Approach. IEEE Transactions on Intelligent Transportation Systems. 2023;24(4):4075-4088. doi:10.1109/tits.2022.3229527

BibTeX
@article{Wang2023,
  author = {Wang, Jiawei and Sun, Lijun},
  title = {Robust Dynamic Bus Control: a Distributional Multi-Agent Reinforcement Learning Approach},
  journal = {IEEE Transactions on Intelligent Transportation Systems},
  year = {2023},
  volume = {24},
  number = {4},
  pages = {4075--4088},
  doi = {10.1109/tits.2022.3229527}
}
Kostenlos starten →