Reinforcement Learning Based Topology Control for UAV Networks
Sensors · 13.01.2023 · 23 (2) · 921
DOI: 10.3390/s23020921 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 13.01.2023. Verfasst von Taehoon Yoo und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Electrical Engineering, Korea University, Seoul 02841, Republic of Korea. Hauptthemen laut MEDLINE: Unmanned Aerial Devices, Learning. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Korea Institute of Energy Technology Evaluation and Planning, National Research Foundation of Korea, National Research Foundation of Korea funded by the Korean Government.
Abstract (Originalsprache)
The recent development of unmanned aerial vehicle (UAV) technology has shown the possibility of using UAVs in many research and industrial fields. One of them is for UAVs moving in swarms to provide wireless networks in environments where there is no network infrastructure. Although this method has the advantage of being able to provide a network quickly and at a low cost, it may cause scalability problems in multi-hop connectivity and UAV control when trying to cover a large area. Therefore, as more UAVs are used to form drone networks, the problem of efficiently controlling the network topology must be solved. To solve this problem, we propose a topology control system for drone networks, which analyzes relative positions among UAVs within a swarm, then optimizes connectivity among them in perspective of both interference and energy consumption, and finally reshapes a logical structure of drone networks by choosing neighbors per UAV and mapping data flows over them. The most important function in the scheme is the connectivity optimization because it should be adaptively conducted according to the dynamically changing complex network conditions, which includes network characteristics such as user density and UAV characteristics such as power consumption. Since neither a simple mathematical framework nor a network simulation tool for optimization can be a solution, we need to resort to reinforcement learning, specifically DDPG, with which each UAV can adjust its connectivity to other drones. In addition, the proposed system minimizes the learning time by flexibly changing the number of steps used for parameter learning according to the deployment of new UAVs. The performance of the proposed system was verified through simulation experiments and theoretical analysis on various topologies consisting of multiple UAVs.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Electrical Engineering, Korea University, Seoul 02841, Republic of Korea.
ORCID-Profile: Taehoon Yoo, Sangmin Lee, Kyeonghyun Yoo, Hwangnam Kim
Förderung
- Korea Institute of Energy Technology Evaluation and Planning
- National Research Foundation of Korea
- National Research Foundation of Korea funded by the Korean Government
Zitieren
APA
Yoo, T., Lee, S., Yoo, K., & Kim, H. (2023). Reinforcement Learning Based Topology Control for UAV Networks. Sensors, 23(2), 921. https://doi.org/10.3390/s23020921
Vancouver
Yoo T, Lee S, Yoo K, Kim H. Reinforcement Learning Based Topology Control for UAV Networks. Sensors. 2023;23(2):921. doi:10.3390/s23020921
BibTeX
@article{Yoo2023,
author = {Yoo, Taehoon and Lee, Sangmin and Yoo, Kyeonghyun and Kim, Hwangnam},
title = {Reinforcement Learning Based Topology Control for UAV Networks},
journal = {Sensors},
year = {2023},
volume = {23},
number = {2},
pages = {921},
doi = {10.3390/s23020921}
}
EUVIMED