EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload

Song Liu iD, Shiyuan Yang, Hanze Zhang, Weiguo Wu

Sensors · 16.02.2023 · 23 (4) · 2243

DOI: 10.3390/s23042243 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 16.02.2023. Verfasst von Song Liu und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an 710049, China. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Basic Research Program of Shaanxi, Shandong Provincial Natural Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rise of latency-sensitive and computationally intensive applications in mobile edge computing (MEC) environments, the computation offloading strategy has been widely studied to meet the low-latency demands of these applications. However, the uncertainty of various tasks and the time-varying conditions of wireless networks make it difficult for mobile devices to make efficient decisions. The existing methods also face the problems of long-delay decisions and user data privacy disclosures. In this paper, we present the FDRT, a federated learning and deep reinforcement learning-based method with two types of agents for computation offload, to minimize the system latency. FDRT uses a multi-agent collaborative computation offloading strategy, namely, DRT. DRT divides the offloading decision into whether to compute tasks locally and whether to offload tasks to MEC servers. The designed DDQN agent considers the task information, its own resources, and the network status conditions of mobile devices, and the designed D3QN agent considers these conditions of all MEC servers in the collaborative cloud-side end MEC system; both jointly learn the optimal decision. FDRT also applies federated learning to reduce communication overhead and optimize the model training of DRT by designing a new parameter aggregation method, while protecting user data privacy. The simulation results showed that DRT effectively reduced the average task execution delay by up to 50% compared with several baselines and state-of-the-art offloading strategies. FRDT also accelerates the convergence rate of multi-agent training and reduces the training time of DRT by 61.7%.

Schlagwörter

Stichwörter der Autor:innen

computation offloading strategydeep reinforcement learningfederated learningmobile edge computingmulti-agent system

Autor:innen und Institutionen

  • School of Computer Science and Technology, Xi'an Jiaotong University, Xi'an 710049, China.

ORCID-Profile: Song Liu

Förderung

  • National Natural Science Foundation of China
  • Natural Science Basic Research Program of Shaanxi
  • Shandong Provincial Natural Science Foundation
  • the National Natural Science Foundation of China

Zitieren

APA

Liu, S., Yang, S., Zhang, H., & Wu, W. (2023). A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload. Sensors, 23(4), 2243. https://doi.org/10.3390/s23042243

Vancouver

Liu S, Yang S, Zhang H, Wu W. A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload. Sensors. 2023;23(4):2243. doi:10.3390/s23042243

BibTeX
@article{Liu2023,
  author = {Liu, Song and Yang, Shiyuan and Zhang, Hanze and Wu, Weiguo},
  title = {A Federated Learning and Deep Reinforcement Learning-Based Method with Two Types of Agents for Computation Offload},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {4},
  pages = {2243},
  doi = {10.3390/s23042243}
}
Kostenlos starten →