EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Lyapunov-Guided Resource Allocation and Task Scheduling for Edge Computing Cognitive Radio Networks via Deep Reinforcement Learning

Chi Xu, Peifeng Zhang, Haibin Yu

IEEE Sensors Journal · 01.04.2025 · 25 (7) · 12253-12264

DOI: 10.1109/jsen.2025.3542972 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Sensors Journal, erschienen am 01.04.2025. Verfasst von Chi Xu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Science and Technology Program of Liaoning Province, Liaoning Revitalization Talents Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Employing cognitive radio to facilitate edge computing is a promising solution to address the spectrum scarcity problem during massive task offloading. This article studies an edge computing cognitive radio network (EC-CRN), where multiple cognitive end devices (CEDs) offload tasks to multiple cognitive base stations (CBSs) for parallel edge computing over the licensed spectrum underlying primary users (PUs). To jointly optimize resource allocation and task scheduling, we formulate a long-term average system cost minimization (ASCM) problem subject to the constraints of end-edge task division, the maximum transmission power of CEDs, the peak interference power to PUs, the computing frequency of CBSs and the long-term energy consumption of CEDs. Due to the long-term objective and long-term constraint coupled slot-by-slot, we employ the Lyapunov optimization theory to derive the upper bound of the Lyapunov drift for the virtual energy consumption backlog and transform the original problem into a one-slot Lyapunov drift-plus-penalty minimization problem. Furthermore, we model the transformed problem by the Markov decision process (MDP) and propose the Lyapunov-guided resource allocation and task scheduling (LRATS) algorithm based on the deep reinforcement learning algorithm with proximal policy optimization (PPO), where the policy network is updated by the policy gradient ascent with adaptive trajectory expectation sampling, and the value network is updated by minimizing the mean squared error of temporal difference (TD). By comparing with benchmark algorithms based on greedy, particle swarm optimization (PSO), deep deterministic policy gradient (DDPG), twin delayed deep deterministic (TD3), and soft actor-critic (SAC) and making ablation experiments, we validate that the proposed algorithm can stably converge with a larger reward and effectively reduce the system cost.

Förderung

  • National Natural Science Foundation of China
  • Science and Technology Program of Liaoning Province
  • Liaoning Revitalization Talents Program

Zitieren

APA

Xu, C., Zhang, P., & Yu, H. (2025). Lyapunov-Guided Resource Allocation and Task Scheduling for Edge Computing Cognitive Radio Networks via Deep Reinforcement Learning. IEEE Sensors Journal, 25(7), 12253-12264. https://doi.org/10.1109/jsen.2025.3542972

Vancouver

Xu C, Zhang P, Yu H. Lyapunov-Guided Resource Allocation and Task Scheduling for Edge Computing Cognitive Radio Networks via Deep Reinforcement Learning. IEEE Sensors Journal. 2025;25(7):12253-12264. doi:10.1109/jsen.2025.3542972

BibTeX
@article{Xu2025,
  author = {Xu, Chi and Zhang, Peifeng and Yu, Haibin},
  title = {Lyapunov-Guided Resource Allocation and Task Scheduling for Edge Computing Cognitive Radio Networks via Deep Reinforcement Learning},
  journal = {IEEE Sensors Journal},
  year = {2025},
  volume = {25},
  number = {7},
  pages = {12253--12264},
  doi = {10.1109/jsen.2025.3542972}
}
Kostenlos starten →