EUVIMEDEUVIMED entdecken
Crossref

Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing

Zhengming Zhang, Yongming Huang, Cheng Zhang, Qingbi Zheng, Luxi Yang, Xiaohu You

IEEE Transactions on Communications · 2024-10 · 72 (10) · 6209-6224

DOI: 10.1109/tcomm.2024.3395698 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Communications, 2024-10. Verfasst von Zhengming Zhang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 64-mal zitiert (Crossref) und nennt 37 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, Natural Science Foundation on Frontier Leading Technology Basic Research Project of Jiangsu.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Network slicing-based communication systems can dynamically and efficiently allocate resources for diversified services. However, due to the limitation of the network interface on channel access and the complexity of the resource allocation, it is challenging to achieve an acceptable solution in the practical system without precise prior knowledge of the dynamics probability model of the service requests. Existing work attempts to solve this problem using deep reinforcement learning (DRL). However, such methods usually require a lot of interaction with the real environment to achieve good results. In this paper, a framework consisting of a digital twin and reinforcement learning agents is present to handle the issue. Specifically, we propose to use the historical data and the neural networks to build a digital twin model to simulate the state variation law of the real environment. Then, we use the data generated by the network slicing environment to calibrate the digital twin so that it is in sync with the real environment. Finally, DRL for slice optimization optimizes its performance in this virtual pre-verification environment. We conducted an exhaustive verification of the proposed digital twin framework to confirm its scalability. Specifically, we propose to use loss landscapes to visualize the generalization of DRL solutions. We explore a distillation-based optimization scheme for lightweight slicing strategies. In addition, we also extend the framework to offline reinforcement learning, where solutions can be used to obtain intelligent decisions based solely on historical data. Numerical simulation experiments show that the proposed digital twin can significantly improve the performance of the slice optimization strategy.

Förderung

  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities
  • Natural Science Foundation on Frontier Leading Technology Basic Research Project of Jiangsu
  • Major Key Project of PCL

Zitieren

APA

Zhang, Z., Huang, Y., Zhang, C., Zheng, Q., Yang, L., & You, X. (2024). Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing. IEEE Transactions on Communications, 72(10), 6209-6224. https://doi.org/10.1109/tcomm.2024.3395698

Vancouver

Zhang Z, Huang Y, Zhang C, Zheng Q, Yang L, You X. Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing. IEEE Transactions on Communications. 2024;72(10):6209-6224. doi:10.1109/tcomm.2024.3395698

BibTeX
@article{Zhang2024,
  author = {Zhang, Zhengming and Huang, Yongming and Zhang, Cheng and Zheng, Qingbi and Yang, Luxi and You, Xiaohu},
  title = {Digital Twin-Enhanced Deep Reinforcement Learning for Resource Management in Networks Slicing},
  journal = {IEEE Transactions on Communications},
  year = {2024},
  volume = {72},
  number = {10},
  pages = {6209--6224},
  doi = {10.1109/tcomm.2024.3395698}
}
Kostenlos starten →