Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV
Drones · 15.05.2024 · 8 (5) · 199
DOI: 10.3390/drones8050199 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 15.05.2024. Verfasst von Xiang Liu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 37-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key Technologies R&D Program of Jiangsu (Prospective and Key Technologies for Industry), Key R&D Plan of Jiangsu Province.
Abstract (Originalsprache)
To address the issue of limited application scenarios associated with connectivity assurance based on two-dimensional (2D) trajectory planning, this paper proposes an improved deep reinforcement learning (DRL) -based three-dimensional (3D) trajectory planning method for cellular unmanned aerial vehicles (UAVs) communication. By considering the 3D space environment and integrating factors such as UAV mission completion time and connectivity, we develop an objective function for path optimization and utilize the advanced dueling double deep Q network (D3QN) to optimize it. Additionally, we introduce the prioritized experience replay (PER) mechanism to enhance learning efficiency and expedite convergence. In order to further aid in trajectory planning, our method incorporates a simultaneous navigation and radio mapping (SNARM) framework that generates simulated 3D radio maps and simulates flight processes by utilizing measurement signals from the UAV during flight, thereby reducing actual flight costs. The simulation results demonstrate that the proposed approach effectively enable UAVs to avoid weak coverage regions in space, thereby reducing the weighted sum of flight time and expected interruption time.
Förderung
- Key Technologies R&D Program of Jiangsu (Prospective and Key Technologies for Industry)
- Key R&D Plan of Jiangsu Province
Zitieren
APA
Liu, X., Zhong, W., Wang, X., Duan, H., Fan, Z., Jin, H., Huang, Y., & Lin, Z. (2024). Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV. Drones, 8(5), 199. https://doi.org/10.3390/drones8050199
Vancouver
Liu X, Zhong W, Wang X, Duan H, Fan Z, Jin H, et al. Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV. Drones. 2024;8(5):199. doi:10.3390/drones8050199
BibTeX
@article{Liu2024,
author = {Liu, Xiang and Zhong, Weizhi and Wang, Xin and Duan, Hongtao and Fan, Zhenxiong and Jin, Haowen and Huang, Yang and Lin, Zhipeng},
title = {Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV},
journal = {Drones},
year = {2024},
volume = {8},
number = {5},
pages = {199},
doi = {10.3390/drones8050199}
}
EUVIMED