EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reinforcement-Learning-Based Multi-UAV Cooperative Search for Moving Targets in 3D Scenarios

Yifei Liu, Xiaoshuai Li, Jian Wang, Feiyu Wei, Junan Yang

Drones · 06.08.2024 · 8 (8) · 378

DOI: 10.3390/drones8080378 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 06.08.2024. Verfasst von Yifei Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 55-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Most existing multi-UAV collaborative search methods only consider scenarios of two-dimensional path planning or static target search. To be close to the practical scenario, this paper proposes a path planning method based on an action-mask-based multi-agent proximal policy optimization (AM-MAPPO) algorithm for multiple UAVs searching for moving targets in three-dimensional (3D) environments. In particular, a multi-UAV high–low altitude collaborative search architecture is introduced that not only takes into account the extensive detection range of high-altitude UAVs but also leverages the benefit of the superior detection quality of low-altitude UAVs. The optimization objective of the search task is to minimize the uncertainty of the search area while maximizing the number of captured moving targets. The path planning problem for moving target search in a 3D environment is formulated and addressed using the AM-MAPPO algorithm. The proposed method incorporates a state representation mechanism based on field-of-view encoding to handle dynamic changes in neural network input dimensions and develops a rule-based target capture mechanism and an action-mask-based collision avoidance mechanism to enhance the AM-MAPPO algorithm’s convergence speed. Experimental results demonstrate that the proposed algorithm significantly reduces regional uncertainty and increases the number of captured moving targets compared to other deep reinforcement learning methods. Ablation studies further indicate that the proposed action mask mechanism, target capture mechanism, and collision avoidance mechanism of the AM-MAPPO algorithm can improve the algorithm’s effectiveness, target capture capability, and UAVs’ safety, respectively.

Förderung

  • Natural Science Foundation of China

Zitieren

APA

Liu, Y., Li, X., Wang, J., Wei, F., & Yang, J. (2024). Reinforcement-Learning-Based Multi-UAV Cooperative Search for Moving Targets in 3D Scenarios. Drones, 8(8), 378. https://doi.org/10.3390/drones8080378

Vancouver

Liu Y, Li X, Wang J, Wei F, Yang J. Reinforcement-Learning-Based Multi-UAV Cooperative Search for Moving Targets in 3D Scenarios. Drones. 2024;8(8):378. doi:10.3390/drones8080378

BibTeX
@article{Liu2024,
  author = {Liu, Yifei and Li, Xiaoshuai and Wang, Jian and Wei, Feiyu and Yang, Junan},
  title = {Reinforcement-Learning-Based Multi-UAV Cooperative Search for Moving Targets in 3D Scenarios},
  journal = {Drones},
  year = {2024},
  volume = {8},
  number = {8},
  pages = {378},
  doi = {10.3390/drones8080378}
}
Kostenlos starten →