EUVIMEDEUVIMED entdecken
Crossref

UAV-Enabled Collaborative Beamforming via Multi-Agent Deep Reinforcement Learning

Saichao Liu, Geng Sun, Jiahui Li, Shuang Liang, Qingqing Wu, Pengfei Wang, Dusit Niyato

IEEE Transactions on Mobile Computing · 2024-12 · 23 (12) · 13015-13032

DOI: 10.1109/tmc.2024.3419915 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-12. Verfasst von Saichao Liu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 65 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Science and Technology Development Plan Project of Jilin Province, National Research Foundation Singapore.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this paper, we investigate an unmanned aerial vehicle (UAV)-assistant air-to-ground communication system, where multiple UAVs form a UAV-enabled virtual antenna array (UVAA) to communicate with remote base stations by utilizing collaborative beamforming. To improve the work efficiency of the UVAA, we formulate a UAV-enabled collaborative beamforming multi-objective optimization problem (UCBMOP) to simultaneously maximize the transmission rate of the UVAA and minimize the energy consumption of all UAVs by optimizing the positions and excitation current weights of all UAVs. This problem is challenging because these two optimization objectives conflict with each other, and they are non-concave to the optimization variables. Moreover, the system is dynamic, and the cooperation among UAVs is complex, making traditional methods take much time to compute the optimization solution for a single task. In addition, as the task changes, the previously obtained solution will become obsolete and invalid. To handle these issues, we leverage the multi-agent deep reinforcement learning (MADRL) to address the UCBMOP. Specifically, we use the heterogeneous-agent trust region policy optimization (HATRPO) as the basic framework, and then propose an improved HATRPO algorithm, namely HATRPO-UCB, where three techniques are introduced to enhance the performance. Simulation results demonstrate that the proposed algorithm can learn a better strategy compared with other methods. Moreover, extensive experiments also demonstrate the effectiveness of the proposed techniques.

Förderung

  • National Natural Science Foundation of China
  • Science and Technology Development Plan Project of Jilin Province
  • National Research Foundation Singapore
  • Info-communications Media Development Authority
  • Future Communications Research and Development Programme
  • AI Singapore Programme AISG
  • Ministry of Education - Singapore

Zitieren

APA

Liu, S., Sun, G., Li, J., Liang, S., Wu, Q., Wang, P., & Niyato, D. (2024). UAV-Enabled Collaborative Beamforming via Multi-Agent Deep Reinforcement Learning. IEEE Transactions on Mobile Computing, 23(12), 13015-13032. https://doi.org/10.1109/tmc.2024.3419915

Vancouver

Liu S, Sun G, Li J, Liang S, Wu Q, Wang P, et al. UAV-Enabled Collaborative Beamforming via Multi-Agent Deep Reinforcement Learning. IEEE Transactions on Mobile Computing. 2024;23(12):13015-13032. doi:10.1109/tmc.2024.3419915

BibTeX
@article{Liu2024,
  author = {Liu, Saichao and Sun, Geng and Li, Jiahui and Liang, Shuang and Wu, Qingqing and Wang, Pengfei and Niyato, Dusit},
  title = {UAV-Enabled Collaborative Beamforming via Multi-Agent Deep Reinforcement Learning},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2024},
  volume = {23},
  number = {12},
  pages = {13015--13032},
  doi = {10.1109/tmc.2024.3419915}
}
Kostenlos starten →