EUVIMEDEUVIMED entdecken
Crossref

Distributed Pursuit-Evasion Game of Limited Perception USV Swarm Based on Multiagent Proximal Policy Optimization

Fanbiao Li, Mengmeng Yin, Tengda Wang, Tingwen Huang, Chunhua Yang, Weihua Gui

IEEE Transactions on Systems, Man, and Cybernetics: Systems · 2024-10 · 54 (10) · 6435-6446

DOI: 10.1109/tsmc.2024.3429467 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2024-10. Verfasst von Fanbiao Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 72-mal zitiert (Crossref) und nennt 27 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Science Fund for Excellent Young Scholars of China, Major Science and Technology Projects in Hunan Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article proposes a distributed capture strategy optimization method for the pursuit-evasion game involving multiple unmanned surface vehicles. Considering the limited perception range of each pursuer, a multiagent proximal policy optimization method combined with a novel velocity control mechanism is utilized to guide the pursuers in approaching the evader and form a dynamic encirclement. Moreover, to facilitate deep reinforcement learning (DRL) training, a bidirectional gated recurrent unit feature network is constructed to extract the fixed-length vector representations from the variable-length observation sequences. In terms of the policy training, by employing virtual barriers and curriculum learning techniques during the training process, the generalization capabilities and convergence speed of the policy have been further improved. Finally, our method is compared with the other DRL methods through the comparative simulation experiments and virtual reality scene testing based on the gazebo three dimensional physics engine, verifying its significant advantages in the policy convergence speed, capture efficiency, and generalization capabilities.

Förderung

  • National Key Research and Development Program of China
  • National Science Fund for Excellent Young Scholars of China
  • Major Science and Technology Projects in Hunan Province
  • Key Research and Development Program of Hunan Province

Zitieren

APA

Li, F., Yin, M., Wang, T., Huang, T., Yang, C., & Gui, W. (2024). Distributed Pursuit-Evasion Game of Limited Perception USV Swarm Based on Multiagent Proximal Policy Optimization. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 54(10), 6435-6446. https://doi.org/10.1109/tsmc.2024.3429467

Vancouver

Li F, Yin M, Wang T, Huang T, Yang C, Gui W. Distributed Pursuit-Evasion Game of Limited Perception USV Swarm Based on Multiagent Proximal Policy Optimization. IEEE Transactions on Systems, Man, and Cybernetics: Systems. 2024;54(10):6435-6446. doi:10.1109/tsmc.2024.3429467

BibTeX
@article{Li2024,
  author = {Li, Fanbiao and Yin, Mengmeng and Wang, Tengda and Huang, Tingwen and Yang, Chunhua and Gui, Weihua},
  title = {Distributed Pursuit-Evasion Game of Limited Perception USV Swarm Based on Multiagent Proximal Policy Optimization},
  journal = {IEEE Transactions on Systems, Man, and Cybernetics: Systems},
  year = {2024},
  volume = {54},
  number = {10},
  pages = {6435--6446},
  doi = {10.1109/tsmc.2024.3429467}
}
Kostenlos starten →