RayNet: A Simulation Platform for Developing Reinforcement Learning-Driven Network Protocols
ACM Transactions on Modeling and Computer Simulation · 31.07.2024 · 34 (3) · 1-25
DOI: 10.1145/3653975 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Modeling and Computer Simulation, online erschienen am 14.06.2024. Verfasst von Luca Giacomoni und 2 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 63 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Reinforcement Learning (RL) has gained significant momentum in the development of network protocols. However, RL-based protocols are still in their infancy, and substantial research is required to build deployable solutions. Developing a protocol based on RL is a complex and challenging process that involves several model design decisions and requires significant training and evaluation in real and simulated network topologies. Network simulators offer an efficient training environment for RL-based protocols because they are deterministic and can run in parallel. In this article, we introduce RayNet , a scalable and adaptable simulation platform for the development of RL-based network protocols. RayNet integrates OMNeT++, a fully programmable network simulator, with Ray/RLlib, a scalable training platform for distributed RL. RayNet facilitates the methodical development of RL-based network protocols so that researchers can focus on the problem at hand and not on implementation details of the learning aspect of their research. We developed a simple RL-based congestion control approach as a proof of concept showcasing that RayNet can be a valuable platform for RL-based research in computer networks, enabling scalable training and evaluation. We compared RayNet with ns3-gym , a platform with similar objectives to RayNet, and showed that RayNet performs better in terms of how fast agents can collect experience in RL environments.
Zitieren
APA
Giacomoni, L., Benny, B., & Parisis, G. (2024). RayNet: A Simulation Platform for Developing Reinforcement Learning-Driven Network Protocols. ACM Transactions on Modeling and Computer Simulation, 34(3), 1-25. https://doi.org/10.1145/3653975
Vancouver
Giacomoni L, Benny B, Parisis G. RayNet: A Simulation Platform for Developing Reinforcement Learning-Driven Network Protocols. ACM Transactions on Modeling and Computer Simulation. 2024;34(3):1-25. doi:10.1145/3653975
BibTeX
@article{Giacomoni2024,
author = {Giacomoni, Luca and Benny, Basil and Parisis, George},
title = {RayNet: A Simulation Platform for Developing Reinforcement Learning-Driven Network Protocols},
journal = {ACM Transactions on Modeling and Computer Simulation},
year = {2024},
volume = {34},
number = {3},
pages = {1--25},
doi = {10.1145/3653975}
}
EUVIMED