Dynamic UAV Deployment for Differentiated Services: A Multi-Agent Imitation Learning Based Approach
IEEE Transactions on Mobile Computing · 01.04.2023 · 22 (4) · 2131-2146
DOI: 10.1109/tmc.2021.3116236 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, erschienen am 01.04.2023. Verfasst von Xiaojie Wang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 124-mal zitiert (Crossref) und nennt 41 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Chongqing Talent Program, Natural Science Foundation of Guangdong Province.
Abstract (Originalsprache)
Unmanned Aerial Vehicles (UAVs) have been utilized to serve on-ground users with various services, e.g., computing, communication and caching, due to their mobility and flexibility. The main focus of many recent studies on UAVs is to deploy a set of homogeneous UAVs with identical capabilities controlled by one UAV owner/company to provide services. However, little attention has been paid to the issue of how to enable different UAV owners to provide services with differentiated service capabilities in a shared area. To address this issue, we propose a multi-agent imitation learning enabled UAV deployment approach to maximize both profits of UAV owners and utilities of on-ground users. Specially, a Markov game is formulated among UAV owners and we prove that a Nash equilibrium exists based on the full knowledge of the system. For online scheduling with incomplete information, we design agent policies by imitating the behaviors of corresponding experts. A novel neural network model, integrating convolutional neural networks, generative adversarial networks and a gradient-based policy, can be trained and executed in a fully decentralized manner with a guaranteed $\epsilon$ ε -Nash equilibrium. Performance results show that our algorithm has significant superiority in terms of average profits, utilities and execution time compared with other representative algorithms.
Förderung
- National Natural Science Foundation of China
- Chongqing Talent Program
- Natural Science Foundation of Guangdong Province
- Hong Kong RGC Research Impact Fund
- General Research Fund
- National Science Foundation
Zitieren
APA
Wang, X., Ning, Z., Guo, S., Wen, M., Guo, L., & Poor, H. V. (2023). Dynamic UAV Deployment for Differentiated Services: A Multi-Agent Imitation Learning Based Approach. IEEE Transactions on Mobile Computing, 22(4), 2131-2146. https://doi.org/10.1109/tmc.2021.3116236
Vancouver
Wang X, Ning Z, Guo S, Wen M, Guo L, Poor HV. Dynamic UAV Deployment for Differentiated Services: A Multi-Agent Imitation Learning Based Approach. IEEE Transactions on Mobile Computing. 2023;22(4):2131-2146. doi:10.1109/tmc.2021.3116236
BibTeX
@article{Wang2023,
author = {Wang, Xiaojie and Ning, Zhaolong and Guo, Song and Wen, Miaowen and Guo, Lei and Poor, H. Vincent},
title = {Dynamic UAV Deployment for Differentiated Services: A Multi-Agent Imitation Learning Based Approach},
journal = {IEEE Transactions on Mobile Computing},
year = {2023},
volume = {22},
number = {4},
pages = {2131--2146},
doi = {10.1109/tmc.2021.3116236}
}
EUVIMED