NetConfEval: Can LLMs Facilitate Network Configuration?
Proceedings of the ACM on Networking · 13.06.2024 · 2 (CoNEXT2) · 1-25
DOI: 10.1145/3656296 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Networking, online erschienen am 13.06.2024. Verfasst von Changjie Wang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 109-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: European Research Council, Swedish Research Council, KTH Digital Futures.
Abstract (Originalsprache)
This paper explores opportunities to utilize Large Language Models (LLMs) to make network configuration human-friendly, simplifying the configuration of network devices & development of routing algorithms and minimizing errors. We design a set of benchmarks (NetConfEval) to examine the effectiveness of different models in facilitating and automating network configuration. More specifically, we focus on the scenarios where LLMs translate high-level policies, requirements, and descriptions (i.e., specified in natural language) into low-level network configurations & Python code. NetConfEval considers four tasks that could potentially facilitate network configuration, such as (i) generating high-level requirements into a formal specification format, (ii) generating API/function calls from high-level requirements, (iii) developing routing algorithms based on high-level descriptions, and (iv) generating low-level configuration for existing and new protocols based on input documentation. Learning from the results of our study, we propose a set of principles to design LLM-based systems to configure networks. Finally, we present two GPT-4-based prototypes to (i) automatically configure P4-enabled devices from a set of high-level requirements and (ii) integrate LLMs into existing network synthesizers.
Förderung
- European Research Council
- Swedish Research Council
- KTH Digital Futures
- Vinnova
Zitieren
APA
Wang, C., Scazzariello, M., Farshin, A., Ferlin, S., Kostić, D., & Chiesa, M. (2024). NetConfEval: Can LLMs Facilitate Network Configuration?. Proceedings of the ACM on Networking, 2(CoNEXT2), 1-25. https://doi.org/10.1145/3656296
Vancouver
Wang C, Scazzariello M, Farshin A, Ferlin S, Kostić D, Chiesa M. NetConfEval: Can LLMs Facilitate Network Configuration?. Proceedings of the ACM on Networking. 2024;2(CoNEXT2):1-25. doi:10.1145/3656296
BibTeX
@article{Wang2024,
author = {Wang, Changjie and Scazzariello, Mariano and Farshin, Alireza and Ferlin, Simone and Kostić, Dejan and Chiesa, Marco},
title = {NetConfEval: Can LLMs Facilitate Network Configuration?},
journal = {Proceedings of the ACM on Networking},
year = {2024},
volume = {2},
number = {CoNEXT2},
pages = {1--25},
doi = {10.1145/3656296}
}
EUVIMED