Energy-Efficient Multi-Agent Reinforcement Learning for UAV Trajectory Optimization in Cell-Free Massive MIMO Networks
IEEE Transactions on Wireless Communications · 2025-07 · 24 (7) · 5917-5930
DOI: 10.1109/twc.2025.3550266 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2025-07. Verfasst von Zhilong Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 42 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, ZTE Industry-University-Institute Cooperation Funds.
Abstract (Originalsprache)
To enhance global data transmission, uncrewed aerial vehicle (UAV)-aided space-air-ground integrated networks (SAGIN) represent a pivotal direction for future advancements. In this paper, we focus on the trajectory optimization problem with the goal of maximizing the energy efficiency (EE), thereby balancing the system capacity with energy expenditure. To this end, we first introduce a cell-free SAGIN network where UAVs function as flying access points to serve ground user equipment (GUE). Given that the transmission power of satellite direct-to-cell devices typically exceeds that of GUEs, we investigate the interference effect and derive exact closed-form expressions for the uplink spectral efficiency. In order to improve the service access efficiency, a GUE grouping scheme based on density distribution is proposed. Then, an effective EE analysis model is established considering the power consumption of fixed-wing UAVs. To solve the UAV trajectory optimization problem, two algorithms over two timescales are proposed: a successive convex approximation strategy and a multi-agent reinforcement learning (MARL)-based algorithm. In particular, to reduce the algorithmic complexity, we employ a shared Critic network in the proposed MARL algorithm to reduce the training parameters. Importantly, our approach comprehensively optimizes the UAV trajectory, acceleration, and velocity parameters. The results show that the proposed GUE grouping algorithm and the MARL-based optimization algorithm demonstrate adaptability in dynamic time-varying environments.
Förderung
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- ZTE Industry-University-Institute Cooperation Funds
Zitieren
APA
Liu, Z., Zhang, J., Zeng, Y., & Ai, B. (2025). Energy-Efficient Multi-Agent Reinforcement Learning for UAV Trajectory Optimization in Cell-Free Massive MIMO Networks. IEEE Transactions on Wireless Communications, 24(7), 5917-5930. https://doi.org/10.1109/twc.2025.3550266
Vancouver
Liu Z, Zhang J, Zeng Y, Ai B. Energy-Efficient Multi-Agent Reinforcement Learning for UAV Trajectory Optimization in Cell-Free Massive MIMO Networks. IEEE Transactions on Wireless Communications. 2025;24(7):5917-5930. doi:10.1109/twc.2025.3550266
BibTeX
@article{Liu2025,
author = {Liu, Zhilong and Zhang, Jiayi and Zeng, Yong and Ai, Bo},
title = {Energy-Efficient Multi-Agent Reinforcement Learning for UAV Trajectory Optimization in Cell-Free Massive MIMO Networks},
journal = {IEEE Transactions on Wireless Communications},
year = {2025},
volume = {24},
number = {7},
pages = {5917--5930},
doi = {10.1109/twc.2025.3550266}
}
EUVIMED