EUVIMEDEUVIMED entdecken
Crossref

Differentiated Federated Reinforcement Learning Based Traffic Offloading on Space-Air-Ground Integrated Networks

Yeguang Qin, Yilin Yang, Fengxiao Tang, Xin Yao, Ming Zhao, Nei Kato

IEEE Transactions on Mobile Computing · 2024-12 · 23 (12) · 11000-11013

DOI: 10.1109/tmc.2024.3389011 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-12. Verfasst von Yeguang Qin und 5 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: Changsha Municipal Natural Science Foundation, Natural Science Foundation of Hunan Province, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The Space-Air-Ground Integrated Network (SAGIN) plays a pivotal role as a comprehensive foundational network communication infrastructure, presenting opportunities for highly efficient global data transmission. Nonetheless, given SAGIN's unique characteristics as a dynamically heterogeneous network, conventional network optimization methodologies encounter challenges in satisfying the stringent requirements for network latency and stability inherent to data transmission within this network environment. Therefore, this paper proposes the use of differentiated federated reinforcement learning (DFRL) to solve the traffic offloading problem in SAGIN, i.e., using multiple agents to generate differentiated traffic offloading policies. Considering the differentiated characteristics of each region of SAGIN, DFRL models the traffic offloading policy optimization process as the process of solving the Decentralized Partially Observable Markov Decision Process (DEC-POMDP) problem. The paper proposes a novel Differentiated Federated Soft Actor-Critic (DFSAC) algorithm to solve the problem. The DFSAC algorithm takes the network packet delay as the joint reward value and introduces the global trend model as the joint target action-value function of each agent to guide the update of each agent's policy. The simulation results demonstrate that the traffic offloading policy based on the DFSAC algorithm achieves better performance in terms of network throughput, packet loss rate, and packet delay compared to the traditional federated reinforcement learning approach and other baseline approaches.

Förderung

  • Changsha Municipal Natural Science Foundation
  • Natural Science Foundation of Hunan Province
  • National Natural Science Foundation of China
  • High Performance Computing Center of Central South University

Zitieren

APA

Qin, Y., Yang, Y., Tang, F., Yao, X., Zhao, M., & Kato, N. (2024). Differentiated Federated Reinforcement Learning Based Traffic Offloading on Space-Air-Ground Integrated Networks. IEEE Transactions on Mobile Computing, 23(12), 11000-11013. https://doi.org/10.1109/tmc.2024.3389011

Vancouver

Qin Y, Yang Y, Tang F, Yao X, Zhao M, Kato N. Differentiated Federated Reinforcement Learning Based Traffic Offloading on Space-Air-Ground Integrated Networks. IEEE Transactions on Mobile Computing. 2024;23(12):11000-11013. doi:10.1109/tmc.2024.3389011

BibTeX
@article{Qin2024,
  author = {Qin, Yeguang and Yang, Yilin and Tang, Fengxiao and Yao, Xin and Zhao, Ming and Kato, Nei},
  title = {Differentiated Federated Reinforcement Learning Based Traffic Offloading on Space-Air-Ground Integrated Networks},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2024},
  volume = {23},
  number = {12},
  pages = {11000--11013},
  doi = {10.1109/tmc.2024.3389011}
}
Kostenlos starten →