Blocklength Allocation and Power Control in UAV-Assisted URLLC System via Multi-agent Deep Reinforcement Learning
International Journal of Computational Intelligence Systems · 03.06.2024 · 17 (1)
DOI: 10.1007/s44196-024-00530-8 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computational Intelligence Systems, online erschienen am 03.06.2024. Verfasst von Xinmin Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key Laboratory of Medicinal and Edible Plant Resources Development of Sichuan Education Department, Chengdu University, Guangdong Provincial Key Laboratory of Future Networks of Intelligence, the Chinese University of Hong Kong, Shenzhen, Natural Science Foundation of Sichuan Province.
Abstract (Originalsprache)
Integration of unmanned aerial vehicles (UAVs) with ultra-reliable and low-latency communication (URLLC) systems can improve the real-time communication performance for various industrial internet of things (IIoT) applications. Designing an intelligent resource allocation system is one of the challenges posed by an energy-constrained UAV communication system. Therefore, we formulate a sum rate maximization problem, subject to the UAVs’ energy by optimizing the blocklength allocation and the power control jointly in the uplink UAV-assisted URLLC systems, in which the probabilistic channel model between UAV and users is adopted. The problem is difficult to solve due to the non-convex objective function and the energy constraints, and also challenging to make fast decision in the complex communication environment. Thus, we propose a deep reinforcement learning (DRL)-based scheme to optimize the blocklength allocation and power control jointly. First, transform the original problem into the multi-agent reinforcement learning process, where each subcarrier is regarded as the agent that optimizes its individual blocklength allocation and power control. Then, each agent makes the intelligent decision to obtain the maximum reward value depending on the weighted segmented reward function, which is related to the UAV energy consumption and user rates to improve the rate performance. Finally, the simulation results show that the proposed scheme outperforms the benchmark schemes and has the stable convergence in different settings, such as the learning rate, the error probability, the subcarrier spacing, and the number of users.
Förderung
- Key Laboratory of Medicinal and Edible Plant Resources Development of Sichuan Education Department, Chengdu University
- Guangdong Provincial Key Laboratory of Future Networks of Intelligence, the Chinese University of Hong Kong, Shenzhen
- Natural Science Foundation of Sichuan Province
- Open Fund of Key Laboratory of Civil Aircraft Airworthiness Technology
- National Science Foundation of China
Zitieren
APA
Li, X., Zhang, X., Li, J., Luo, F., Huang, Y., & Zhang, X. (2024). Blocklength Allocation and Power Control in UAV-Assisted URLLC System via Multi-agent Deep Reinforcement Learning. International Journal of Computational Intelligence Systems, 17(1). https://doi.org/10.1007/s44196-024-00530-8
Vancouver
Li X, Zhang X, Li J, Luo F, Huang Y, Zhang X. Blocklength Allocation and Power Control in UAV-Assisted URLLC System via Multi-agent Deep Reinforcement Learning. International Journal of Computational Intelligence Systems. 2024;17(1). doi:10.1007/s44196-024-00530-8
BibTeX
@article{Li2024,
author = {Li, Xinmin and Zhang, Xuhao and Li, Jiahui and Luo, Feiying and Huang, Yi and Zhang, Xiaoqiang},
title = {Blocklength Allocation and Power Control in UAV-Assisted URLLC System via Multi-agent Deep Reinforcement Learning},
journal = {International Journal of Computational Intelligence Systems},
year = {2024},
volume = {17},
number = {1},
doi = {10.1007/s44196-024-00530-8}
}
EUVIMED