Transformer-Based Imitative Reinforcement Learning for Multirobot Path Planning
IEEE Transactions on Industrial Informatics · 2023-10 · 19 (10) · 10233-10243
DOI: 10.1109/tii.2023.3240585 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Industrial Informatics, 2023-10. Verfasst von Lin Chen und 6 weiteren Autor:innen. Die Arbeit wurde bisher 128-mal zitiert (Crossref) und nennt 34 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Science and Technology Innovation Program of Hunan Province.
Abstract (Originalsprache)
Multirobot path planning leads multiple robots from start positions to designated goal positions by generating efficient and collision-free paths. Multirobot systems realize coordination solutions and decentralized path planning, which is essential for large-scale systems. The state-of-the-art decentralized methods utilize imitation learning and reinforcement learning methods to teach fully decentralized policies, dramatically improving their performance. However, these methods cannot enable robots to perform tasks efficiently in relatively dense environments without communication between robots. We introduce the transformer structure into policy neural networks for the first time, dramatically enhancing the ability of policy neural networks to extract features that facilitate collaboration between robots. It mainly focuses on improving the performance of policies in relatively dense multirobot environments under conditions where robots do not communicate with each other. Furthermore, a novel imitation reinforcement learning framework is proposed by combining contrastive learning and double deep Q-network to solve the problem of difficulty training policy neural networks after introducing the transformer structure. We present results in the simulation environment and compare the resulting policy against advanced multirobot path-planning methods in terms of success rate. Simulation results show that our policy achieves state-of-the-art performance when there is no communication between robots. Finally, we experimented with a real-world case using a total of three robots in our robotic laboratory.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Science and Technology Innovation Program of Hunan Province
- Postgraduate Scientific Research Innovation Project of Hunan Province
- Natural Science Foundation of Hunan Province
Zitieren
APA
Chen, L., Wang, Y., Miao, Z., Mo, Y., Feng, M., Zhou, Z., & Wang, H. (2023). Transformer-Based Imitative Reinforcement Learning for Multirobot Path Planning. IEEE Transactions on Industrial Informatics, 19(10), 10233-10243. https://doi.org/10.1109/tii.2023.3240585
Vancouver
Chen L, Wang Y, Miao Z, Mo Y, Feng M, Zhou Z, et al. Transformer-Based Imitative Reinforcement Learning for Multirobot Path Planning. IEEE Transactions on Industrial Informatics. 2023;19(10):10233-10243. doi:10.1109/tii.2023.3240585
BibTeX
@article{Chen2023,
author = {Chen, Lin and Wang, Yaonan and Miao, Zhiqiang and Mo, Yang and Feng, Mingtao and Zhou, Zhen and Wang, Hesheng},
title = {Transformer-Based Imitative Reinforcement Learning for Multirobot Path Planning},
journal = {IEEE Transactions on Industrial Informatics},
year = {2023},
volume = {19},
number = {10},
pages = {10233--10243},
doi = {10.1109/tii.2023.3240585}
}
EUVIMED