EUVIMEDEUVIMED entdecken
Crossref

Multi-UAV Navigation for Partially Observable Communication Coverage by Graph Reinforcement Learning

Zhenhui Ye, Ke Wang, Yining Chen, Xiaohong Jiang, Guanghua Song

IEEE Transactions on Mobile Computing · 01.07.2023 · 22 (7) · 4056-4069

DOI: 10.1109/tmc.2022.3146881 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, erschienen am 01.07.2023. Verfasst von Zhenhui Ye und 4 weiteren Autor:innen. Die Arbeit wurde bisher 126-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: National Key R&D Program of China, Emergent behavior recognition, training and interpretation techniques.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this paper, we aim to design a deep reinforcement learning (DRL) based control solution to navigating a swarm of unmanned aerial vehicles (UAVs) to fly around an unexplored target area under partial observation, which serves as Mobile Base Stations (MBSs) providing optimal communication coverage for the ground mobile users. To handle the information loss caused by the partial observability, we introduce a novel network architecture named Deep Recurrent Graph Network (DRGN), which could obtain extra spatial information through graph-convolution based inter-UAV communication, and utilize historical features with a recurrent unit. Based on DRGN and maximum-entropy learning, we propose a stochastic DRL policy named Soft Deep Recurrent Graph Network (SDRGN). In SDRGN, a heuristic reward function is elaborated, which is based on the local information of each UAV instead of the global information; thus, SDRGN reduces the training cost and enables distributed online learning. We conducted extensive experiments to design the structure of DRGN and examine the performance of SDRGN. The simulation results show that the proposed model outperforms four state-of-the-art DRL-based approaches and three heuristic baselines, and demonstrate the scalability, transferability, robustness, and interpretability of SDRGN.

Förderung

  • National Key R&D Program of China
  • Emergent behavior recognition, training and interpretation techniques

Zitieren

APA

Ye, Z., Wang, K., Chen, Y., Jiang, X., & Song, G. (2023). Multi-UAV Navigation for Partially Observable Communication Coverage by Graph Reinforcement Learning. IEEE Transactions on Mobile Computing, 22(7), 4056-4069. https://doi.org/10.1109/tmc.2022.3146881

Vancouver

Ye Z, Wang K, Chen Y, Jiang X, Song G. Multi-UAV Navigation for Partially Observable Communication Coverage by Graph Reinforcement Learning. IEEE Transactions on Mobile Computing. 2023;22(7):4056-4069. doi:10.1109/tmc.2022.3146881

BibTeX
@article{Ye2023,
  author = {Ye, Zhenhui and Wang, Ke and Chen, Yining and Jiang, Xiaohong and Song, Guanghua},
  title = {Multi-UAV Navigation for Partially Observable Communication Coverage by Graph Reinforcement Learning},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2023},
  volume = {22},
  number = {7},
  pages = {4056--4069},
  doi = {10.1109/tmc.2022.3146881}
}
Kostenlos starten →