EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization

Vijayalakshmi K. Kumarasamy, Abhilasha Jairam Saroj, Yu Liang, Dalei Wu, Michael P. Hunter, Angshuman Guin, Mina Sartipi

Symmetry · 07.04.2024 · 16 (4) · 448

DOI: 10.3390/sym16040448 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Symmetry, online erschienen am 07.04.2024. Verfasst von Vijayalakshmi K. Kumarasamy und 6 weiteren Autor:innen. Die Arbeit wurde bisher 45-mal zitiert (Crossref) und nennt 85 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: U.S. Department of Energy’s Office of Energy Efficiency and Renewable Energy (EERE).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system.

Förderung

  • U.S. Department of Energy’s Office of Energy Efficiency and Renewable Energy (EERE)

Zitieren

APA

Kumarasamy, V. K., Saroj, A. J., Liang, Y., Wu, D., Hunter, M. P., Guin, A., & Sartipi, M. (2024). Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization. Symmetry, 16(4), 448. https://doi.org/10.3390/sym16040448

Vancouver

Kumarasamy VK, Saroj AJ, Liang Y, Wu D, Hunter MP, Guin A, et al. Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization. Symmetry. 2024;16(4):448. doi:10.3390/sym16040448

BibTeX
@article{Kumarasamy2024,
  author = {Kumarasamy, Vijayalakshmi K. and Saroj, Abhilasha Jairam and Liang, Yu and Wu, Dalei and Hunter, Michael P. and Guin, Angshuman and Sartipi, Mina},
  title = {Integration of Decentralized Graph-Based Multi-Agent Reinforcement Learning with Digital Twin for Traffic Signal Optimization},
  journal = {Symmetry},
  year = {2024},
  volume = {16},
  number = {4},
  pages = {448},
  doi = {10.3390/sym16040448}
}
Kostenlos starten →