CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs
Proceedings of the ACM on Measurement and Analysis of Computing Systems · 29.05.2026 · 10 (2) · 1-28
DOI: 10.1145/3805631 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Measurement and Analysis of Computing Systems, online erschienen am 29.05.2026. Verfasst von Xi Jiang und 2 weiteren Autor:innen. Die Arbeit nennt 72 Literaturangaben.
Abstract (Originalsprache)
Verifying network configurations is critical for ensuring operational stability, but traditional tools force a trade-off between the high manual effort of model checkers and the semantic shallowness of consistency checkers. More importantly, neither class of tools offers interpretable, human-readable explanations to support diagnosis. Large Language Models (LLMs) present a promising alternative by enabling both detection and explanation. However, naive approaches like full-file, partition-based, or chain-of-thought prompting fail to handle the large, interconnected nature of configuration files. We introduce the Context-Aware Prompting (CAP) framework, which enables an LLM to reason about network configurations like a human expert. CAP first identifies all potentially relevant neighboring, similar, and referenced configuration segments. It then engages the LLM in a structured dialogue, where the model requests the specific context it needs before performing a focused analysis. This on-demand approach provides the necessary context for deep reasoning while avoiding overload. Our evaluation on production network configurations demonstrates that CAP reliably detects a wide range of known and previously unknown configuration errors. CAP substantially outperforms existing LLM-based baselines, while achieving performance comparable to state-of-the-art non-LLM tools. CAP is most effective on misconfigurations that require reasoning over references and intricate dependencies.
Zitieren
APA
Jiang, X., Gember-Jacobson, A., & Feamster, N. (2026). CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs. Proceedings of the ACM on Measurement and Analysis of Computing Systems, 10(2), 1-28. https://doi.org/10.1145/3805631
Vancouver
Jiang X, Gember-Jacobson A, Feamster N. CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs. Proceedings of the ACM on Measurement and Analysis of Computing Systems. 2026;10(2):1-28. doi:10.1145/3805631
BibTeX
@article{Jiang2026,
author = {Jiang, Xi and Gember-Jacobson, Aaron and Feamster, Nick},
title = {CAP: Detecting Network Device Misconfigurations with Context-Aware Prompting of LLMs},
journal = {Proceedings of the ACM on Measurement and Analysis of Computing Systems},
year = {2026},
volume = {10},
number = {2},
pages = {1--28},
doi = {10.1145/3805631}
}
EUVIMED