Deep Reinforcement Learning and NOMA-Based Multi-Objective RIS-Assisted IS-UAV-TNs: Trajectory Optimization and Beamforming Design
IEEE Transactions on Intelligent Transportation Systems · 2023-09 · 24 (9) · 10197-10210
DOI: 10.1109/tits.2023.3267607 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Intelligent Transportation Systems, 2023-09. Verfasst von Kefeng Guo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 115-mal zitiert (Crossref) und nennt 56 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Henan Provincial Science and Technology Research Project, Key Laboratory of Cognitive Radio and Information Processing, Ministry of Education.
Abstract (Originalsprache)
In this paper, we discuss the co-optimized performance of multi-reconfigurable intelligent surface (RIS)-assisted integrated satellite-unmanned aerial vehicle-terrestrial network (IS-UAV-TN), where the multiple vehicle users are applied to the network under consideration. The performance optimization of IS-UAV-TNs faces two major challenges: one is the obstacles in the transmission path and the other is the highly dynamic communication environment caused by the UAV movement for the multiple ground vehicle users. To tackle these above issues efficiently, we will install RIS on the UAV for the purpose of reshaping the wireless transmission path. In addition, non-orthogonal multiple access (NOMA) protocols are considered as a new paradigm to address spectrum shortage and enhance connection quality. Considering the UAV energy consumption, the satellite transmission beamforming matrix and RIS phase shift configuration, a multi-objective optimization problem is proposed to maximize the system achievable rate and minimize the UAV energy consumption during a specific mission. On this foundation, to facilitate the online decision problem, the deep reinforcement learning (DRL) algorithm is utilized to achieve real-time interaction with the communication environment. A multi-objective deep deterministic policy gradient (MO-DDPG) algorithm is proposed to search for sub-optimal solutions about the learning problem of multi-objective control policies in IS-UAV-TNs. Experimental results show that the method can simultaneously consider three optimization objectives and effectively adjust the optimal update policy according to the settings of different weight parameters.
Förderung
- National Natural Science Foundation of China
- Henan Provincial Science and Technology Research Project
- Key Laboratory of Cognitive Radio and Information Processing, Ministry of Education
- Basic and Applied Basic Research Foundation of Guangdong Province
Zitieren
APA
Guo, K., Wu, M., Li, X., Song, H., & Kumar, N. (2023). Deep Reinforcement Learning and NOMA-Based Multi-Objective RIS-Assisted IS-UAV-TNs: Trajectory Optimization and Beamforming Design. IEEE Transactions on Intelligent Transportation Systems, 24(9), 10197-10210. https://doi.org/10.1109/tits.2023.3267607
Vancouver
Guo K, Wu M, Li X, Song H, Kumar N. Deep Reinforcement Learning and NOMA-Based Multi-Objective RIS-Assisted IS-UAV-TNs: Trajectory Optimization and Beamforming Design. IEEE Transactions on Intelligent Transportation Systems. 2023;24(9):10197-10210. doi:10.1109/tits.2023.3267607
BibTeX
@article{Guo2023,
author = {Guo, Kefeng and Wu, Min and Li, Xingwang and Song, Houbing and Kumar, Neeraj},
title = {Deep Reinforcement Learning and NOMA-Based Multi-Objective RIS-Assisted IS-UAV-TNs: Trajectory Optimization and Beamforming Design},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2023},
volume = {24},
number = {9},
pages = {10197--10210},
doi = {10.1109/tits.2023.3267607}
}
EUVIMED