EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

UAV Swarm Cooperative Dynamic Target Search: A MAPPO-Based Discrete Optimal Control Method

Dexing Wei, Lun Zhang, Quan Liu, Hao Chen, Jian Huang

Drones · 22.05.2024 · 8 (6) · 214

DOI: 10.3390/drones8060214 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 22.05.2024. Verfasst von Dexing Wei und 4 weiteren Autor:innen. Die Arbeit wurde bisher 39-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Unmanned aerial vehicles (UAVs) are commonly employed in pursuit and rescue missions, where the target’s trajectory is unknown. Traditional methods, such as evolutionary algorithms and ant colony optimization, can generate a search route in a given scenario. However, when the scene changes, the solution needs to be recalculated. In contrast, more advanced deep reinforcement learning methods can train an agent that can be directly applied to a similar task without recalculation. Nevertheless, there are several challenges when the agent learns how to search for unknown dynamic targets. In this search task, the rewards are random and sparse, which makes learning difficult. In addition, because of the need for the agent to adapt to various scenario settings, interactions required between the agent and the environment are more comparable to typical reinforcement learning tasks. These challenges increase the difficulty of training agents. To address these issues, we propose the OC-MAPPO method, which combines optimal control (OC) and Multi-Agent Proximal Policy Optimization (MAPPO) with GPU parallelization. The optimal control model provides the agent with continuous and stable rewards. Through parallelized models, the agent can interact with the environment and collect data more rapidly. Experimental results demonstrate that the proposed method can help the agent learn faster, and the algorithm demonstrated a 26.97% increase in the success rate compared to genetic algorithms.

Zitieren

APA

Wei, D., Zhang, L., Liu, Q., Chen, H., & Huang, J. (2024). UAV Swarm Cooperative Dynamic Target Search: A MAPPO-Based Discrete Optimal Control Method. Drones, 8(6), 214. https://doi.org/10.3390/drones8060214

Vancouver

Wei D, Zhang L, Liu Q, Chen H, Huang J. UAV Swarm Cooperative Dynamic Target Search: A MAPPO-Based Discrete Optimal Control Method. Drones. 2024;8(6):214. doi:10.3390/drones8060214

BibTeX
@article{Wei2024,
  author = {Wei, Dexing and Zhang, Lun and Liu, Quan and Chen, Hao and Huang, Jian},
  title = {UAV Swarm Cooperative Dynamic Target Search: A MAPPO-Based Discrete Optimal Control Method},
  journal = {Drones},
  year = {2024},
  volume = {8},
  number = {6},
  pages = {214},
  doi = {10.3390/drones8060214}
}
Kostenlos starten →