Deep Reinforcement Learning Based Resource Allocation and Trajectory Planning in Integrated Sensing and Communications UAV Network
IEEE Transactions on Wireless Communications · 2023-11 · 22 (11) · 8158-8169
DOI: 10.1109/twc.2023.3260304 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2023-11. Verfasst von Yunhui Qin und 4 weiteren Autor:innen. Die Arbeit wurde bisher 185-mal zitiert (Crossref) und nennt 42 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Beijing Natural Science Foundation, China University Industry-University-Research Collaborative Innovation Fund.
Abstract (Originalsprache)
In this paper, multi-UAVs serve as mobile aerial ISAC platforms to sense and communicate with on-ground target users. To optimize the communication and sensing performance, we formulate a joint user association, UAV trajectory planning and power allocation problem to maximize the minimum weighted spectral efficiency among UAVs. This paper exploits the centralized and the decentralized deep reinforcement learning (DRL) solutions to solve the sequential decision-making problem. On one hand, we first introduce the centralized soft actor-critic (SAC) algorithm. Then, we explore the equivalent transformation of the optimization objective based on symmetric group, propose the random and the adaptive data augmentation schemes to design the replay memory buffer of SAC, and accordingly propose SAC algorithms assisted by data augmentation to tackle the transformed problem. On the other hand, the multi-agent soft actor-critic (MASAC), a decentralized solution, is also introduced to solve this sequential decision-making problem. The experiment results reveal the effectiveness of the centralized and the decentralized solutions in considered scenarios. Specifically, the SAC assisted by the adaptive scheme significantly outperforms other centralized solutions in the training speed and the weighted spectral efficiency. Meanwhile, the decentralized MASAC algorithm behaves best in the early training speed.
Förderung
- National Natural Science Foundation of China
- Beijing Natural Science Foundation
- China University Industry-University-Research Collaborative Innovation Fund
Zitieren
APA
Qin, Y., Zhang, Z., Li, X., Huangfu, W., & Zhang, H. (2023). Deep Reinforcement Learning Based Resource Allocation and Trajectory Planning in Integrated Sensing and Communications UAV Network. IEEE Transactions on Wireless Communications, 22(11), 8158-8169. https://doi.org/10.1109/twc.2023.3260304
Vancouver
Qin Y, Zhang Z, Li X, Huangfu W, Zhang H. Deep Reinforcement Learning Based Resource Allocation and Trajectory Planning in Integrated Sensing and Communications UAV Network. IEEE Transactions on Wireless Communications. 2023;22(11):8158-8169. doi:10.1109/twc.2023.3260304
BibTeX
@article{Qin2023,
author = {Qin, Yunhui and Zhang, Zhongshan and Li, Xulong and Huangfu, Wei and Zhang, Haijun},
title = {Deep Reinforcement Learning Based Resource Allocation and Trajectory Planning in Integrated Sensing and Communications UAV Network},
journal = {IEEE Transactions on Wireless Communications},
year = {2023},
volume = {22},
number = {11},
pages = {8158--8169},
doi = {10.1109/twc.2023.3260304}
}
EUVIMED