EUVIMEDEUVIMED entdecken
Crossref

Improving the Efficiency and Efficacy of Multi-Agent Reinforcement Learning on Complex Railway Networks with a Local-Critic Approach

Yuan Zhang, Umashankar Deekshith, Jianhong Wang, Joschka Boedecker

Proceedings of the International Conference on Automated Planning and Scheduling · 30.05.2024 · 34 · 698-706

DOI: 10.1609/icaps.v34i1.31533 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the International Conference on Automated Planning and Scheduling, online erschienen am 30.05.2024. Verfasst von Yuan Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The complex railway network is a challenging real-world multi-agent system usually involving thousands of agents. Current planning methods heavily depend on expert knowledge to formulate solutions for specific cases and are therefore hardly generalized to new scenarios, on which multi-agent reinforcement learning (MARL) draws significant attention. Despite some successful applications in multi-agent decision-making tasks, MARL is hard to scale to a large number of agents. This paper rethinks the curse of agents in the centralized-training-decentralized-execution (CTDE) paradigm and proposes a local-critic approach to address the issue. By combining the local critic with the PPO algorithm, we design a deep MARL algorithm denoted as local-critic PPO (LCPPO). In experiments, we evaluate the effectiveness of LCPPO on a complex railway network benchmark, Flatland, with various numbers of agents. Noticeably, LCPPO shows prominent generalizability and robustness under the changes of environments.

Zitieren

APA

Zhang, Y., Deekshith, U., Wang, J., & Boedecker, J. (2024). Improving the Efficiency and Efficacy of Multi-Agent Reinforcement Learning on Complex Railway Networks with a Local-Critic Approach. Proceedings of the International Conference on Automated Planning and Scheduling, 34, 698-706. https://doi.org/10.1609/icaps.v34i1.31533

Vancouver

Zhang Y, Deekshith U, Wang J, Boedecker J. Improving the Efficiency and Efficacy of Multi-Agent Reinforcement Learning on Complex Railway Networks with a Local-Critic Approach. Proceedings of the International Conference on Automated Planning and Scheduling. 2024;34:698-706. doi:10.1609/icaps.v34i1.31533

BibTeX
@article{Zhang2024,
  author = {Zhang, Yuan and Deekshith, Umashankar and Wang, Jianhong and Boedecker, Joschka},
  title = {Improving the Efficiency and Efficacy of Multi-Agent Reinforcement Learning on Complex Railway Networks with a Local-Critic Approach},
  journal = {Proceedings of the International Conference on Automated Planning and Scheduling},
  year = {2024},
  volume = {34},
  pages = {698--706},
  doi = {10.1609/icaps.v34i1.31533}
}
Kostenlos starten →