EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs

Xi Jiang, Aaron Gember-Jacobson, Nick Feamster

ACM SIGMETRICS Performance Evaluation Review · 20.07.2026 · 54 (1) · 138-140

DOI: 10.1145/3820171.3806917 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM SIGMETRICS Performance Evaluation Review, online erschienen am 27.07.2026. Verfasst von Xi Jiang und 2 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSF (National Science Foundation).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Traditional tools for verifying network configurations: (1) require high manual effort or lack semantic depth, and (2) lack interpretable, human-readable explanations to support diagnosis. Large Language Models (LLMs) present a promising alternative, but simple approaches like full-file, partition-based, or chain-of-thought prompting fail to handle the large, interconnected nature of configuration files. We introduce the Context-Aware Prompting (CAP) framework, which enables an LLM to reason about network configurations like a human expert. CAP first identifies all potentially relevant neighboring, similar, and referenced configuration segments. CAP then engages the LLM in a structured dialogue, where the model requests the specific context it needs before performing a focused analysis. This on-demand approach provides the necessary context for deep reasoning while avoiding overload. Our evaluation on production network configurations demonstrates that CAP reliably detects a wide range of known and previously unknown configuration errors. CAP outperforms existing LLM-based baselines, and achieves performance comparable to state-of-the-art non-LLM tools.

Förderung

  • NSF (National Science Foundation)

Zitieren

APA

Jiang, X., Gember-Jacobson, A., & Feamster, N. (2026). CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs. ACM SIGMETRICS Performance Evaluation Review, 54(1), 138-140. https://doi.org/10.1145/3820171.3806917

Vancouver

Jiang X, Gember-Jacobson A, Feamster N. CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs. ACM SIGMETRICS Performance Evaluation Review. 2026;54(1):138-140. doi:10.1145/3820171.3806917

BibTeX
@article{Jiang2026,
  author = {Jiang, Xi and Gember-Jacobson, Aaron and Feamster, Nick},
  title = {CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs},
  journal = {ACM SIGMETRICS Performance Evaluation Review},
  year = {2026},
  volume = {54},
  number = {1},
  pages = {138--140},
  doi = {10.1145/3820171.3806917}
}
Kostenlos starten →