CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs
ACM SIGMETRICS Performance Evaluation Review · 20.07.2026 · 54 (1) · 138-140
DOI: 10.1145/3820171.3806917 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM SIGMETRICS Performance Evaluation Review, online erschienen am 27.07.2026. Verfasst von Xi Jiang und 2 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSF (National Science Foundation).
Abstract (Originalsprache)
Traditional tools for verifying network configurations: (1) require high manual effort or lack semantic depth, and (2) lack interpretable, human-readable explanations to support diagnosis. Large Language Models (LLMs) present a promising alternative, but simple approaches like full-file, partition-based, or chain-of-thought prompting fail to handle the large, interconnected nature of configuration files. We introduce the Context-Aware Prompting (CAP) framework, which enables an LLM to reason about network configurations like a human expert. CAP first identifies all potentially relevant neighboring, similar, and referenced configuration segments. CAP then engages the LLM in a structured dialogue, where the model requests the specific context it needs before performing a focused analysis. This on-demand approach provides the necessary context for deep reasoning while avoiding overload. Our evaluation on production network configurations demonstrates that CAP reliably detects a wide range of known and previously unknown configuration errors. CAP outperforms existing LLM-based baselines, and achieves performance comparable to state-of-the-art non-LLM tools.
Förderung
- NSF (National Science Foundation)
Zitieren
APA
Jiang, X., Gember-Jacobson, A., & Feamster, N. (2026). CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs. ACM SIGMETRICS Performance Evaluation Review, 54(1), 138-140. https://doi.org/10.1145/3820171.3806917
Vancouver
Jiang X, Gember-Jacobson A, Feamster N. CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs. ACM SIGMETRICS Performance Evaluation Review. 2026;54(1):138-140. doi:10.1145/3820171.3806917
BibTeX
@article{Jiang2026,
author = {Jiang, Xi and Gember-Jacobson, Aaron and Feamster, Nick},
title = {CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs},
journal = {ACM SIGMETRICS Performance Evaluation Review},
year = {2026},
volume = {54},
number = {1},
pages = {138--140},
doi = {10.1145/3820171.3806917}
}
EUVIMED