Fault Tolerance Oriented SFC Optimization in SDN/NFV-Enabled Cloud Environment Based on Deep Reinforcement Learning
IEEE Transactions on Cloud Computing · 2024-01 · 12 (1) · 200-218
DOI: 10.1109/tcc.2024.3357061 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Cloud Computing, 2024-01. Verfasst von Jing Chen und 7 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 61 Literaturangaben. Gefördert von: National Key R&D Program of China, PCL, Central Universities.
Abstract (Originalsprache)
In software defined network/network function virtualization (SDN/NFV)-enabled cloud environment, cloud services can be implemented as service function chains (SFCs), which consist of a series of ordered virtual network functions. However, due to fluctuations of cloud traffic and without knowledge of cloud computing network configuration, designing SFC optimization approach to obtain flexible cloud services in dynamic cloud environment is a pivotal challenge. In this paper, we propose a fault tolerance oriented SFC optimization approach based on deep reinforcement learning. We model fault tolerance oriented SFC elastic optimization problem as a Markov decision process, in which the reward is modeled as a weighted function, including minimizing energy consumption and migration cost, maximizing revenue benefit and load balancing. Then, taking binary integer programming model as constraints of quality of cloud services, we design optimization approaches for single-agent double deep Q-network (SADDQN) and multi-agent DDQN (MADDQN). Among them, MADDQN decentralizes training tasks from control plane to data plane to reduce the probability of single point of failure for the centralized controller. Experimental results show that the designed approaches have better performance. MADDQN can almost reach the upper bound of theoretical solution obtained by assuming a prior knowledge of the dynamics of cloud traffic.
Förderung
- National Key R&D Program of China
- PCL
- Central Universities
- Zhejiang Lab
- Nature and Science Foundation of China
Zitieren
APA
Chen, J., Chen, J., Guo, K., Hu, R., Zou, T., Zhu, J., Zhang, H., & Liu, J. (2024). Fault Tolerance Oriented SFC Optimization in SDN/NFV-Enabled Cloud Environment Based on Deep Reinforcement Learning. IEEE Transactions on Cloud Computing, 12(1), 200-218. https://doi.org/10.1109/tcc.2024.3357061
Vancouver
Chen J, Chen J, Guo K, Hu R, Zou T, Zhu J, et al. Fault Tolerance Oriented SFC Optimization in SDN/NFV-Enabled Cloud Environment Based on Deep Reinforcement Learning. IEEE Transactions on Cloud Computing. 2024;12(1):200-218. doi:10.1109/tcc.2024.3357061
BibTeX
@article{Chen2024,
author = {Chen, Jing and Chen, Jia and Guo, Kuo and Hu, Renkun and Zou, Tao and Zhu, Jun and Zhang, Hongke and Liu, Jingjing},
title = {Fault Tolerance Oriented SFC Optimization in SDN/NFV-Enabled Cloud Environment Based on Deep Reinforcement Learning},
journal = {IEEE Transactions on Cloud Computing},
year = {2024},
volume = {12},
number = {1},
pages = {200--218},
doi = {10.1109/tcc.2024.3357061}
}
EUVIMED