Dynamic Trajectory and Power Control in Ultra-Dense AAV Networks: A Mean-Field Reinforcement Learning Approach
IEEE Transactions on Wireless Communications · 2025-07 · 24 (7) · 5620-5634
DOI: 10.1109/twc.2025.3548127 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2025-07. Verfasst von Fei Song und 5 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Technologies Research and Development Program of Jiangsu, Major Natural Science Foundation of the Higher Education Institutions of Jiangsu Province.
Abstract (Originalsprache)
In ultra-dense autonomous aerial vehicle (AAV) networks, it is challenging to coordinate the resource allocation and interference management among large-scale AAVs, for providing flexible and efficient service coverage to the ground users (GUs). In this paper, we propose a learning-based resource allocation scheme in an ultra-dense AAV communication network, where the GUs’ service demands are time-varying with unknown distributions. We formulate the non-cooperative game among multiple co-channel AAVs as a stochastic game, where each AAV jointly optimizes its trajectory, user association, and downlink power control to maximize the expectation of its locally cumulative energy efficiency under the interference and energy constraints. To cope with the scalability issue in a large-scale network, we further formulate the problem as a mean-field game (MFG), which simplifies the interactions among the AAVs into a two-player game between a representative AAV and a mean-field. We prove the existence and uniqueness of the equilibrium for the MFG, and propose a model-free mean-field reinforcement learning algorithm named maximum entropy mean-field deep Q network (ME-MFDQN) to solve the mean-field equilibrium in both fully and partially observable scenarios. The simulation results reveal that the proposed algorithm improves the energy efficiency compared with the benchmark algorithms. Moreover, the performance can be further enhanced if the GUs’ service demands exhibit higher temporal correlation or if the AAVs have wider observation capabilities over their nearby GUs.
Förderung
- National Natural Science Foundation of China
- Key Technologies Research and Development Program of Jiangsu
- Major Natural Science Foundation of the Higher Education Institutions of Jiangsu Province
- Program of Science and Technology Cooperation of Nanjing with International/Hong Kong, Macau, and Taiwan
- Shanghai Kewei
Zitieren
APA
Song, F., Wang, Z., Li, J., Shi, L., Chen, W., & Jin, S. (2025). Dynamic Trajectory and Power Control in Ultra-Dense AAV Networks: A Mean-Field Reinforcement Learning Approach. IEEE Transactions on Wireless Communications, 24(7), 5620-5634. https://doi.org/10.1109/twc.2025.3548127
Vancouver
Song F, Wang Z, Li J, Shi L, Chen W, Jin S. Dynamic Trajectory and Power Control in Ultra-Dense AAV Networks: A Mean-Field Reinforcement Learning Approach. IEEE Transactions on Wireless Communications. 2025;24(7):5620-5634. doi:10.1109/twc.2025.3548127
BibTeX
@article{Song2025,
author = {Song, Fei and Wang, Zhe and Li, Jun and Shi, Long and Chen, Wen and Jin, Shi},
title = {Dynamic Trajectory and Power Control in Ultra-Dense AAV Networks: A Mean-Field Reinforcement Learning Approach},
journal = {IEEE Transactions on Wireless Communications},
year = {2025},
volume = {24},
number = {7},
pages = {5620--5634},
doi = {10.1109/twc.2025.3548127}
}
EUVIMED