EUVIMEDEUVIMED entdecken
Crossref

Throughput Maximization With an AoI Constraint in Energy Harvesting D2D-Enabled Cellular Networks: An MSRA-TD3 Approach

Xiaoying Liu, Jiaxiang Xu, Kechen Zheng, Guanglin Zhang, Jia Liu, Norio Shiratori

IEEE Transactions on Wireless Communications · 2025-02 · 24 (2) · 1448-1466

DOI: 10.1109/twc.2024.3509475 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Wireless Communications, 2025-02. Verfasst von Xiaoying Liu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 64-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Provincial Universities of Zhejiang, Program for Professor of Special Appointment at Shanghai Institutions of Higher Learning.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The energy harvesting D2D-enabled cellular network (EH-DCN) has emerged as a promising approach to address the issues of energy supply and spectrum utilization. Most of existing works mainly focus on the throughput, while the information freshness, which is critical to the time-sensitive applications, has been rarely explored. Considering above facts, we aim to develop an optimal mode selection and resource allocation (MSRA) policy that maximizes the long-term overall throughput of a time-varying dynamic EH-DCN, subject to an age of information (AoI) constraint. As the MSRA policy involves both continuous variables (i.e., bandwidth, power, and time allocations) and discrete variables (i.e., mode selection and channel allocation), the optimization problem is proved to be nonconvex and NP-hard. To solve the nonconvex NP-hard problem, we exploit a deep reinforcement learning (DRL) approach, called MSRA twin delayed deep deterministic policy gradient (MSRA-TD3). The MSRA-TD3 employs a double critic network structure to better fit the reward function, and could effectively mitigate the overestimation of Q-value in deep deterministic policy gradient (DDPG), which is a classical DRL algorithm. It is worth noting that in the design of the MSRA-TD3, we use the throughput of user equipments (UEs) at the previous time slot as a state to bypass the channel state information estimation resulting from the time-varying dynamic environment, and take the weights of throughput and AoI penalty into the reward function to evaluate two performance. Simulations demonstrate that the established MSRA-TD3 algorithm achieves better performance in terms of throughput and AoI than comparison DRL algorithms.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Provincial Universities of Zhejiang
  • Program for Professor of Special Appointment at Shanghai Institutions of Higher Learning
  • Science and Technology Commission of Shanghai Municipality
  • JSPS KAKENHI Grant Number
  • Project of Cyber Security Establishment with Inter-University Cooperation

Zitieren

APA

Liu, X., Xu, J., Zheng, K., Zhang, G., Liu, J., & Shiratori, N. (2025). Throughput Maximization With an AoI Constraint in Energy Harvesting D2D-Enabled Cellular Networks: An MSRA-TD3 Approach. IEEE Transactions on Wireless Communications, 24(2), 1448-1466. https://doi.org/10.1109/twc.2024.3509475

Vancouver

Liu X, Xu J, Zheng K, Zhang G, Liu J, Shiratori N. Throughput Maximization With an AoI Constraint in Energy Harvesting D2D-Enabled Cellular Networks: An MSRA-TD3 Approach. IEEE Transactions on Wireless Communications. 2025;24(2):1448-1466. doi:10.1109/twc.2024.3509475

BibTeX
@article{Liu2025,
  author = {Liu, Xiaoying and Xu, Jiaxiang and Zheng, Kechen and Zhang, Guanglin and Liu, Jia and Shiratori, Norio},
  title = {Throughput Maximization With an AoI Constraint in Energy Harvesting D2D-Enabled Cellular Networks: An MSRA-TD3 Approach},
  journal = {IEEE Transactions on Wireless Communications},
  year = {2025},
  volume = {24},
  number = {2},
  pages = {1448--1466},
  doi = {10.1109/twc.2024.3509475}
}
Kostenlos starten →