EUVIMEDEUVIMED entdecken
Crossref

Transformer-Based Imitative Reinforcement Learning for Multirobot Path Planning

Lin Chen, Yaonan Wang, Zhiqiang Miao, Yang Mo, Mingtao Feng, Zhen Zhou, Hesheng Wang

IEEE Transactions on Industrial Informatics · 2023-10 · 19 (10) · 10233-10243

DOI: 10.1109/tii.2023.3240585 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Industrial Informatics, 2023-10. Verfasst von Lin Chen und 6 weiteren Autor:innen. Die Arbeit wurde bisher 128-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Science and Technology Innovation Program of Hunan Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multirobot path planning leads multiple robots from start positions to designated goal positions by generating efficient and collision-free paths. Multirobot systems realize coordination solutions and decentralized path planning, which is essential for large-scale systems. The state-of-the-art decentralized methods utilize imitation learning and reinforcement learning methods to teach fully decentralized policies, dramatically improving their performance. However, these methods cannot enable robots to perform tasks efficiently in relatively dense environments without communication between robots. We introduce the transformer structure into policy neural networks for the first time, dramatically enhancing the ability of policy neural networks to extract features that facilitate collaboration between robots. It mainly focuses on improving the performance of policies in relatively dense multirobot environments under conditions where robots do not communicate with each other. Furthermore, a novel imitation reinforcement learning framework is proposed by combining contrastive learning and double deep Q-network to solve the problem of difficulty training policy neural networks after introducing the transformer structure. We present results in the simulation environment and compare the resulting policy against advanced multirobot path-planning methods in terms of success rate. Simulation results show that our policy achieves state-of-the-art performance when there is no communication between robots. Finally, we experimented with a real-world case using a total of three robots in our robotic laboratory.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Science and Technology Innovation Program of Hunan Province
  • Postgraduate Scientific Research Innovation Project of Hunan Province
  • Natural Science Foundation of Hunan Province

Zitieren

APA

Chen, L., Wang, Y., Miao, Z., Mo, Y., Feng, M., Zhou, Z., & Wang, H. (2023). Transformer-Based Imitative Reinforcement Learning for Multirobot Path Planning. IEEE Transactions on Industrial Informatics, 19(10), 10233-10243. https://doi.org/10.1109/tii.2023.3240585

Vancouver

Chen L, Wang Y, Miao Z, Mo Y, Feng M, Zhou Z, et al. Transformer-Based Imitative Reinforcement Learning for Multirobot Path Planning. IEEE Transactions on Industrial Informatics. 2023;19(10):10233-10243. doi:10.1109/tii.2023.3240585

BibTeX
@article{Chen2023,
  author = {Chen, Lin and Wang, Yaonan and Miao, Zhiqiang and Mo, Yang and Feng, Mingtao and Zhou, Zhen and Wang, Hesheng},
  title = {Transformer-Based Imitative Reinforcement Learning for Multirobot Path Planning},
  journal = {IEEE Transactions on Industrial Informatics},
  year = {2023},
  volume = {19},
  number = {10},
  pages = {10233--10243},
  doi = {10.1109/tii.2023.3240585}
}
Kostenlos starten →