Hierarchical Reinforcement Learning in Multi-Domain Elastic Optical Networks to Realize Joint RMSA
Journal of Lightwave Technology · 15.04.2023 · 41 (8) · 2276-2288
DOI: 10.1109/jlt.2023.3235039 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Lightwave Technology, erschienen am 15.04.2023. Verfasst von Liufei Xu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province.
Abstract (Originalsprache)
To improve the network scalability, a large elastic optical network is typically segmented into multiple autonomous domains, where each domain possesses high autonomy and privacy. This architecture is referred to as the multi-domain elastic optical network (MDEON). In the MDEON, the routing, modulation, and spectrum allocation (RMSA) for the inter-domain service requests are challenging. As a result, deep reinforcement learning (DRL) has been introduced recently where the RMSA policies are learned during the interaction of the DRL agents with the MDEON environment. Due to the autonomy of each domain in the MDEON, joint RMSA is essential to improve the overall performance. To realize the joint RMSA, we propose a hierarchical reinforcement learning (HRL) framework which consists of a high-level DRL module and multiple low-level DRL modules (one for each domain), with the collaboration of DRL modules. More specifically, for the inter-domain service requests, the high-level module obtains some abstracted information from the low-level DRL modules and generates the inter-domain RMSA decision for the low-level modules. Then the low-level DRL module gives the intra-domain RMSA decision and feeds back to the high-level module. The proposed HRL framework preserves the autonomy of each single domain while delivering effective overall network performance through the cooperation of the high-level and low-level DRL modules. Simulation results demonstrate that our proposed method outperforms previous approaches.
Förderung
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province
Zitieren
APA
Xu, L., Huang, Y., Xue, Y., & Hu, X. (2023). Hierarchical Reinforcement Learning in Multi-Domain Elastic Optical Networks to Realize Joint RMSA. Journal of Lightwave Technology, 41(8), 2276-2288. https://doi.org/10.1109/jlt.2023.3235039
Vancouver
Xu L, Huang Y, Xue Y, Hu X. Hierarchical Reinforcement Learning in Multi-Domain Elastic Optical Networks to Realize Joint RMSA. Journal of Lightwave Technology. 2023;41(8):2276-2288. doi:10.1109/jlt.2023.3235039
BibTeX
@article{Xu2023,
author = {Xu, Liufei and Huang, Yue-Cai and Xue, Yun and Hu, Xiaohui},
title = {Hierarchical Reinforcement Learning in Multi-Domain Elastic Optical Networks to Realize Joint RMSA},
journal = {Journal of Lightwave Technology},
year = {2023},
volume = {41},
number = {8},
pages = {2276--2288},
doi = {10.1109/jlt.2023.3235039}
}
EUVIMED