EUVIMEDEUVIMED entdecken
Crossref

Two-Timescale Learning-Based Task Offloading for Remote IoT in Integrated Satellite–Terrestrial Networks

Dairu Han, Qiang Ye, Haixia Peng, Wen Wu, Huaqing Wu, Wenhe Liao, Xuemin Shen

IEEE Internet of Things Journal · 15.06.2023 · 10 (12) · 10131-10145

DOI: 10.1109/jiot.2023.3237209 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 15.06.2023. Verfasst von Dairu Han und 6 weiteren Autor:innen. Die Arbeit wurde bisher 95-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: Major Key Project of the Peng Cheng Laboratory, National Natural Science Foundation of China, Natural Sciences and Engineering Research Council of Canada.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this article, we propose an integrated satellite–terrestrial network (ISTN) architecture to support delay-sensitive task offloading for remote Internet of Things (IoT), in which satellite networks serve as a complement to terrestrial networks by providing additional communication resources, backhaul capacities, and seamless coverage. Under this architecture, we investigate how to jointly make offloading link selection and bandwidth allocation decisions for BSs and IoT users. Considering the differentiated decision-making time granularities, we formulate a two-timescale stochastic optimization problem to minimize the overall task offloading delay. To accommodate the two-timescale network dynamics and characterize state–action relations, we establish a hierarchical Markov decision process (H-MDP) framework with two separate agents tackling two-timescale network management decisions, and two evolved MDP-based subproblems are formulated accordingly. To efficiently solve the subproblems, we further develop a hybrid proximal policy optimization (H-PPO)-based algorithm. Specifically, a hybrid actor–critic architecture is designed to deal with the mixed discrete and continuous actions. In addition, an action mask layer and an action shaping function are designed to sample feasible task offloading decisions from the time-variant action set. Extensive simulation results have validated the superiority of the proposed ISTN architecture and the H-PPO-based algorithm, especially, in scenarios with scarce spectrum resources and heavy traffic loads.

Förderung

  • Major Key Project of the Peng Cheng Laboratory
  • National Natural Science Foundation of China
  • Natural Sciences and Engineering Research Council of Canada

Zitieren

APA

Han, D., Ye, Q., Peng, H., Wu, W., Wu, H., Liao, W., & Shen, X. (2023). Two-Timescale Learning-Based Task Offloading for Remote IoT in Integrated Satellite–Terrestrial Networks. IEEE Internet of Things Journal, 10(12), 10131-10145. https://doi.org/10.1109/jiot.2023.3237209

Vancouver

Han D, Ye Q, Peng H, Wu W, Wu H, Liao W, et al. Two-Timescale Learning-Based Task Offloading for Remote IoT in Integrated Satellite–Terrestrial Networks. IEEE Internet of Things Journal. 2023;10(12):10131-10145. doi:10.1109/jiot.2023.3237209

BibTeX
@article{Han2023,
  author = {Han, Dairu and Ye, Qiang and Peng, Haixia and Wu, Wen and Wu, Huaqing and Liao, Wenhe and Shen, Xuemin},
  title = {Two-Timescale Learning-Based Task Offloading for Remote IoT in Integrated Satellite–Terrestrial Networks},
  journal = {IEEE Internet of Things Journal},
  year = {2023},
  volume = {10},
  number = {12},
  pages = {10131--10145},
  doi = {10.1109/jiot.2023.3237209}
}
Kostenlos starten →