Leveraging Deep Reinforcement Learning With Attention Mechanism for Virtual Network Function Placement and Routing
IEEE Transactions on Parallel and Distributed Systems · 2023-04 · 34 (4) · 1186-1201
DOI: 10.1109/tpds.2023.3240404 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Parallel and Distributed Systems, 2023-04. Verfasst von Nan He und 6 weiteren Autor:innen. Die Arbeit wurde bisher 73-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: National Natural Science Foundation of China, EU H2020 COSAFE project, EU Horizon CODECO project.
Abstract (Originalsprache)
The efficacy of Network Function Virtualization (NFV) depends critically on (1) where the virtual network functions (VNFs) are placed and (2) how the traffic is routed. Unfortunately, these aspects are not easily optimized, especially under time-varying network states with different QoS requirements. Given the importance of NFV, many approaches have been proposed to solve the VNF placement and Service Function Chaining (SFC) routing problem. However, those prior approaches mainly assume that the network state is static and known, disregarding dynamic network variations. To bridge that gap, we leverage Markov Decision Process (MDP) to model the dynamic network state transitions. To jointly minimize the delay and cost of NFV providers and maximize the revenue, we first devise a customized Deep Reinforcement Learning (DRL) algorithm for the VNF placement problem. The algorithm uses the attention mechanism to ascertain smooth network behavior within the general framework of network utility maximization (NUM). We then propose attention mechanism-based DRL algorithm for the SFC routing problem, which is to find the path to deliver traffic for the VNFs placed on different nodes. The simulation results show that our proposed algorithms outperform the state-of-the-art algorithms in terms of network utility, delay, cost, and acceptance ratio.
Förderung
- National Natural Science Foundation of China
- EU H2020 COSAFE project
- EU Horizon CODECO project
Zitieren
APA
He, N., Yang, S., Li, F., Trajanovski, S., Zhu, L., Wang, Y., & Fu, X. (2023). Leveraging Deep Reinforcement Learning With Attention Mechanism for Virtual Network Function Placement and Routing. IEEE Transactions on Parallel and Distributed Systems, 34(4), 1186-1201. https://doi.org/10.1109/tpds.2023.3240404
Vancouver
He N, Yang S, Li F, Trajanovski S, Zhu L, Wang Y, et al. Leveraging Deep Reinforcement Learning With Attention Mechanism for Virtual Network Function Placement and Routing. IEEE Transactions on Parallel and Distributed Systems. 2023;34(4):1186-1201. doi:10.1109/tpds.2023.3240404
BibTeX
@article{He2023,
author = {He, Nan and Yang, Song and Li, Fan and Trajanovski, Stojan and Zhu, Liehuang and Wang, Yu and Fu, Xiaoming},
title = {Leveraging Deep Reinforcement Learning With Attention Mechanism for Virtual Network Function Placement and Routing},
journal = {IEEE Transactions on Parallel and Distributed Systems},
year = {2023},
volume = {34},
number = {4},
pages = {1186--1201},
doi = {10.1109/tpds.2023.3240404}
}
EUVIMED