Research on Multi-Robot Formation Control Based on MATD3 Algorithm
Applied Sciences · 31.01.2023 · 13 (3) · 1874
DOI: 10.3390/app13031874 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 31.01.2023. Verfasst von Conghang Zhou und 3 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Fujian Province, Science Research Foundation for Introduced Talents, Fujian Province of China.
Abstract (Originalsprache)
This paper investigates the problem of multi-robot formation control strategies in environments with obstacles based on deep reinforcement learning methods. To solve the problem of value function overestimation in the deep deterministic policy gradient (DDPG) algorithm, this paper proposes an improved multi-agent twin delayed deep deterministic policy gradient (MATD3) algorithm under the CTDE framework combined with the twin delayed deep deterministic policy gradient (TD3) algorithm, which adopts a prioritized experience replay strategy to improve the learning efficiency. For the problem of difficult obstacle avoidance for a robot formation, a hybrid reward mechanism is designed to use different formation maintenance strategies in obstacle areas and obstacle-free areas to achieve the control goal of obstacle avoidance by reasonably changing the formation. The simulation experiments verified the effectiveness of the multi-robot formation control strategy designed in this paper, and comparative simulations verified that the algorithm has a faster convergence speed and more stable performance.
Förderung
- Natural Science Foundation of Fujian Province
- Science Research Foundation for Introduced Talents, Fujian Province of China
Zitieren
APA
Zhou, C., Li, J., Shi, Y., & Lin, Z. (2023). Research on Multi-Robot Formation Control Based on MATD3 Algorithm. Applied Sciences, 13(3), 1874. https://doi.org/10.3390/app13031874
Vancouver
Zhou C, Li J, Shi Y, Lin Z. Research on Multi-Robot Formation Control Based on MATD3 Algorithm. Applied Sciences. 2023;13(3):1874. doi:10.3390/app13031874
BibTeX
@article{Zhou2023,
author = {Zhou, Conghang and Li, Jianxing and Shi, Yujing and Lin, Zhirui},
title = {Research on Multi-Robot Formation Control Based on MATD3 Algorithm},
journal = {Applied Sciences},
year = {2023},
volume = {13},
number = {3},
pages = {1874},
doi = {10.3390/app13031874}
}
EUVIMED