EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Trajectory Planning for UAV-Assisted Data Collection in IoT Network: A Double Deep Q Network Approach

Shuqi Wang, Nan Qi, Hua Jiang, Ming Xiao, Haoxuan Liu, Luliang Jia, Dan Zhao

Electronics · 22.04.2024 · 13 (8) · 1592

DOI: 10.3390/electronics13081592 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 22.04.2024. Verfasst von Shuqi Wang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, National Aerospace Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Unmanned aerial vehicles (UAVs) are becoming increasingly valuable as a new type of mobile communication device and autonomous decision-making device in many application areas, including the Internet of Things (IoT). UAVs have advantages over other stationary devices in terms of high flexibility. However, a UAV, as a mobile device, still faces some challenges in optimizing its trajectory for data collection. Firstly, the high complexity of the movement action and state space of the UAV’s 3D trajectory is not negligible. Secondly, in unknown urban environments, a UAV must avoid obstacles accurately in order to ensure a safe flight. Furthermore, without a priori wireless channel characterization and ground device locations, a UAV must reliably and safely complete the data collection from the ground devices under the threat of unknown interference. All of these require the proposing of intelligent and automatic onboard trajectory optimization techniques. This paper transforms the trajectory optimization problem into a Markov decision process (MDP), and deep reinforcement learning (DRL) is applied to the data collection scenario. Specifically, the double deep Q-network (DDQN) algorithm is designed to address intelligent UAV trajectory planning that enables energy-efficient and safe data collection. Compared with the traditional algorithm, the DDQN algorithm is much better than the traditional Q-Learning algorithm, and the training time of the network is shorter than that of the deep Q-network (DQN) algorithm.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities
  • National Aerospace Science Foundation of China
  • National Mobile Communications Research Laboratory, Southeast University
  • Postgraduate Research and Practice Innovation Program of NUAA

Zitieren

APA

Wang, S., Qi, N., Jiang, H., Xiao, M., Liu, H., Jia, L., & Zhao, D. (2024). Trajectory Planning for UAV-Assisted Data Collection in IoT Network: A Double Deep Q Network Approach. Electronics, 13(8), 1592. https://doi.org/10.3390/electronics13081592

Vancouver

Wang S, Qi N, Jiang H, Xiao M, Liu H, Jia L, et al. Trajectory Planning for UAV-Assisted Data Collection in IoT Network: A Double Deep Q Network Approach. Electronics. 2024;13(8):1592. doi:10.3390/electronics13081592

BibTeX
@article{Wang2024,
  author = {Wang, Shuqi and Qi, Nan and Jiang, Hua and Xiao, Ming and Liu, Haoxuan and Jia, Luliang and Zhao, Dan},
  title = {Trajectory Planning for UAV-Assisted Data Collection in IoT Network: A Double Deep Q Network Approach},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {8},
  pages = {1592},
  doi = {10.3390/electronics13081592}
}
Kostenlos starten →