Distributed Pursuit-Evasion Game of Limited Perception USV Swarm Based on Multiagent Proximal Policy Optimization
IEEE Transactions on Systems, Man, and Cybernetics: Systems · 2024-10 · 54 (10) · 6435-6446
DOI: 10.1109/tsmc.2024.3429467 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2024-10. Verfasst von Fanbiao Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 72-mal zitiert (Crossref) und nennt 27 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Science Fund for Excellent Young Scholars of China, Major Science and Technology Projects in Hunan Province.
Abstract (Originalsprache)
This article proposes a distributed capture strategy optimization method for the pursuit-evasion game involving multiple unmanned surface vehicles. Considering the limited perception range of each pursuer, a multiagent proximal policy optimization method combined with a novel velocity control mechanism is utilized to guide the pursuers in approaching the evader and form a dynamic encirclement. Moreover, to facilitate deep reinforcement learning (DRL) training, a bidirectional gated recurrent unit feature network is constructed to extract the fixed-length vector representations from the variable-length observation sequences. In terms of the policy training, by employing virtual barriers and curriculum learning techniques during the training process, the generalization capabilities and convergence speed of the policy have been further improved. Finally, our method is compared with the other DRL methods through the comparative simulation experiments and virtual reality scene testing based on the gazebo three dimensional physics engine, verifying its significant advantages in the policy convergence speed, capture efficiency, and generalization capabilities.
Förderung
- National Key Research and Development Program of China
- National Science Fund for Excellent Young Scholars of China
- Major Science and Technology Projects in Hunan Province
- Key Research and Development Program of Hunan Province
Zitieren
APA
Li, F., Yin, M., Wang, T., Huang, T., Yang, C., & Gui, W. (2024). Distributed Pursuit-Evasion Game of Limited Perception USV Swarm Based on Multiagent Proximal Policy Optimization. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 54(10), 6435-6446. https://doi.org/10.1109/tsmc.2024.3429467
Vancouver
Li F, Yin M, Wang T, Huang T, Yang C, Gui W. Distributed Pursuit-Evasion Game of Limited Perception USV Swarm Based on Multiagent Proximal Policy Optimization. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2024;54(10):6435-6446. doi:10.1109/tsmc.2024.3429467
BibTeX
@article{Li2024,
author = {Li, Fanbiao and Yin, Mengmeng and Wang, Tengda and Huang, Tingwen and Yang, Chunhua and Gui, Weihua},
title = {Distributed Pursuit-Evasion Game of Limited Perception USV Swarm Based on Multiagent Proximal Policy Optimization},
journal = {IEEE Transactions on Systems, Man, and Cybernetics: Systems},
year = {2024},
volume = {54},
number = {10},
pages = {6435--6446},
doi = {10.1109/tsmc.2024.3429467}
}
EUVIMED