EUVIMEDEUVIMED entdecken
Crossref

Generative Curricula for Multi-Agent Path Finding via Unsupervised and Reinforcement Learning

Thomy Phan, Timy Phan, Sven Koenig

Journal of Artificial Intelligence Research · 27.04.2025 · 82 · 2471-2534

DOI: 10.1613/jair.1.17403 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Artificial Intelligence Research, online erschienen am 27.04.2025. Verfasst von Thomy Phan und 2 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-Agent Path Finding (MAPF) is the challenging problem of finding collision-free paths for multiple agents, which has a wide range of applications, such as automated warehouses, smart manufacturing, and traffic management. Recently, machine learning-based approaches have become popular in addressing MAPF problems in a decentralized and potentially generalizing way. Most learning-based MAPF approaches use reinforcement and imitation learning to train agent policies for decentralized execution under partial observability. However, current state-of-the-art approaches suffer from a prevalent bias to micro-aspects of particular MAPF problems, such as congestions in corridors and potential delays caused by single agents, leading to tight specializations through extensive engineering via oversized models, reward shaping, path finding algorithms, and communication. These specializations are generally detrimental to the sample efficiency, i.e., the learning progress given a certain amount of experience, and generalization to previously unseen scenarios. In contrast, curriculum learning offers an elegant and much simpler way of training agent policies in a step-by-step manner to master all aspects implicitly without extensive engineering. In this paper, we propose a generative curriculum approach to learning-based MAPF using Variational Autoencoder Utilized Learning of Terrains (VAULT). We introduce a two-stage framework to (I) train the VAULT via unsupervised learning to obtain a latent space representation of maps and (II) use the VAULT to generate curricula in order to improve sample efficiency and generalization of learning-based MAPF methods. For the second stage, we propose a bi-level curriculum scheme by combining our VAULT curriculum with a low-level curriculum method to improve sample efficiency further. Our framework is designed in a modular and general way, where each proposed component serves its purpose in a black-box manner without considering specific micro-aspects of the underlying problem. We empirically evaluate our approach in maps of the public MAPF benchmark set as well as novel artificial maps generated with the VAULT. Our results demonstrate the effectiveness of the VAULT as a map generator and our VAULT curriculum in improving sample efficiency and generalization of learning-based MAPF methods compared to alternative approaches. We also demonstrate how data pruning can further reduce the dependence on available maps without affecting the generalization potential of our approach.

Zitieren

APA

Phan, T., Phan, T., & Koenig, S. (2025). Generative Curricula for Multi-Agent Path Finding via Unsupervised and Reinforcement Learning. Journal of Artificial Intelligence Research, 82, 2471-2534. https://doi.org/10.1613/jair.1.17403

Vancouver

Phan T, Phan T, Koenig S. Generative Curricula for Multi-Agent Path Finding via Unsupervised and Reinforcement Learning. Journal of Artificial Intelligence Research. 2025;82:2471-2534. doi:10.1613/jair.1.17403

BibTeX
@article{Phan2025,
  author = {Phan, Thomy and Phan, Timy and Koenig, Sven},
  title = {Generative Curricula for Multi-Agent Path Finding via Unsupervised and Reinforcement Learning},
  journal = {Journal of Artificial Intelligence Research},
  year = {2025},
  volume = {82},
  pages = {2471--2534},
  doi = {10.1613/jair.1.17403}
}
Kostenlos starten →