EUVIMEDEUVIMED entdecken
Crossref

Physical layer-aware deep reinforcement learning with advantage function stabilization for dynamic RMSA in elastic optical networks

Haojie Wang, Yixin Wang, Yongli Zhao, Jie Zhang

Journal of Optical Communications and Networking · 01.03.2026 · 18 (3) · 250

DOI: 10.1364/jocn.577029 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Optical Communications and Networking, online erschienen am 19.02.2026. Verfasst von Haojie Wang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: State Key Laboratory of Information Photonics and Optical Communications.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Dynamic routing, modulation, and spectrum assignment (RMSA) in elastic optical networks (EONs) requires joint optimization considering complex physical layer impairments. While deep reinforcement learning (DRL) has shown promise for RMSA, existing methods face two fundamental limitations: (i) rigid distance-adaptive modulation rules that underutilize spectrum resources and (ii) value estimation bias in continuing tasks that prevents convergence to optimal policies. This paper proposes a physical layer-aware DRL framework that addresses both limitations. First, we incorporate reward centering to eliminate value estimation bias in continuing tasks, enabling the agent to distinguish fine-grained policy differences. Second, the framework enables autonomous joint optimization of routing and modulation selection, removing reliance on distance-based rules. Simulations on NSFNET and COST239 demonstrate two key results: (i) reward centering reduces service blocking probability by 16% compared to standard DRL under identical constraints, and (ii) autonomous modulation selection reduces blocking by up to 77% in high-load regimes where distance-adaptive methods saturate at approximately 16%. Physical layer analysis reveals that performance gains are achieved by operating closer to transmission limits, with the average GSNR margin reduced from 7.1 to 2.7 dB.

Förderung

  • State Key Laboratory of Information Photonics and Optical Communications

Zitieren

APA

Wang, H., Wang, Y., Zhao, Y., & Zhang, J. (2026). Physical layer-aware deep reinforcement learning with advantage function stabilization for dynamic RMSA in elastic optical networks. Journal of Optical Communications and Networking, 18(3), 250. https://doi.org/10.1364/jocn.577029

Vancouver

Wang H, Wang Y, Zhao Y, Zhang J. Physical layer-aware deep reinforcement learning with advantage function stabilization for dynamic RMSA in elastic optical networks. Journal of Optical Communications and Networking. 2026;18(3):250. doi:10.1364/jocn.577029

BibTeX
@article{Wang2026,
  author = {Wang, Haojie and Wang, Yixin and Zhao, Yongli and Zhang, Jie},
  title = {Physical layer-aware deep reinforcement learning with advantage function stabilization for dynamic RMSA in elastic optical networks},
  journal = {Journal of Optical Communications and Networking},
  year = {2026},
  volume = {18},
  number = {3},
  pages = {250},
  doi = {10.1364/jocn.577029}
}
Kostenlos starten →