A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload
Sensors · 16.02.2023 · 23 (4) · 2243
DOI: 10.3390/s23042243 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 16.02.2023. Verfasst von Song Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an 710049, China. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Basic Research Program of Shaanxi, Shandong Provincial Natural Science Foundation.
Abstract (Originalsprache)
With the rise of latency-sensitive and computationally intensive applications in mobile edge computing (MEC) environments, the computation offloading strategy has been widely studied to meet the low-latency demands of these applications. However, the uncertainty of various tasks and the time-varying conditions of wireless networks make it difficult for mobile devices to make efficient decisions. The existing methods also face the problems of long-delay decisions and user data privacy disclosures. In this paper, we present the FDRT, a federated learning and deep reinforcement learning-based method with two types of agents for computation offload, to minimize the system latency. FDRT uses a multi-agent collaborative computation offloading strategy, namely, DRT. DRT divides the offloading decision into whether to compute tasks locally and whether to offload tasks to MEC servers. The designed DDQN agent considers the task information, its own resources, and the network status conditions of mobile devices, and the designed D3QN agent considers these conditions of all MEC servers in the collaborative cloud-side end MEC system; both jointly learn the optimal decision. FDRT also applies federated learning to reduce communication overhead and optimize the model training of DRT by designing a new parameter aggregation method, while protecting user data privacy. The simulation results showed that DRT effectively reduced the average task execution delay by up to 50% compared with several baselines and state-of-the-art offloading strategies. FRDT also accelerates the convergence rate of multi-agent training and reduces the training time of DRT by 61.7%.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an 710049, China.
ORCID-Profile: Song Liu
Förderung
- National Natural Science Foundation of China
- Natural Science Basic Research Program of Shaanxi
- Shandong Provincial Natural Science Foundation
- the National Natural Science Foundation of China
Zitieren
APA
Liu, S., Yang, S., Zhang, H., & Wu, W. (2023). A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload. Sensors, 23(4), 2243. https://doi.org/10.3390/s23042243
Vancouver
Liu S, Yang S, Zhang H, Wu W. A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload. Sensors. 2023;23(4):2243. doi:10.3390/s23042243
BibTeX
@article{Liu2023,
author = {Liu, Song and Yang, Shiyuan and Zhang, Hanze and Wu, Weiguo},
title = {A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload},
journal = {Sensors},
year = {2023},
volume = {23},
number = {4},
pages = {2243},
doi = {10.3390/s23042243}
}
EUVIMED