Identifying performance-sensitive configurations in software systems with LLM-based agents
Empirical Software Engineering · 2026-11 · 31 (6)
DOI: 10.1007/s10664-026-10883-7 ↗Kurz gefasst
Fachartikel in der Zeitschrift Empirical Software Engineering, online erschienen am 28.05.2026. Verfasst von Zehao Wang und 2 weiteren Autor:innen. Die Arbeit nennt 66 Literaturangaben.
Abstract (Originalsprache)
Configuration settings are crucial for adapting software behavior to meet specific performance objectives. However, the prevalence of misconfigurations, combined with the scale and complexity of available options, makes it difficult to determine which configurations have significant performance implications. In this work, we present CongSense, a lightweight framework that employs Large Language Models (LLMs) to systematically identify performance-sensitive configurations with minimal analysis overhead. CongSense employs multiple LLM agents to emulate the reasoning processes of developers and performance engineers, integrating prompting strategies such as prompt chaining and retrieval-augmented generation (RAG). Across seven open-source Java projects, CongSense achieves an average accuracy of 70.55% in classifying performance-sensitive configurations, surpassing both an LLM-based baseline (58.47%) and the previous state-of-the-art approach (60.87%). Evaluations across three LLMs show consistent improvements in accuracy and precision, demonstrating robustness to the choice of foundation model. Notably, prompt chaining yields up to a 17% improvement in precision while preserving recall. A systematic error analysis of 66 consistently misclassified configurations identifies four failure categories, with over 80% of errors caused by misleading performance-related terminology and ungrounded impact reasoning that lead to false positives. Overall, CongSense substantially reduces the manual effort required for configuration analysis and highlights promising directions for LLM-based software performance research.
Zitieren
APA
Wang, Z., Kim, D. J., & Chen, T. P. (2026). Identifying performance-sensitive configurations in software systems with LLM-based agents. Empirical Software Engineering, 31(6). https://doi.org/10.1007/s10664-026-10883-7
Vancouver
Wang Z, Kim DJ, Chen TP. Identifying performance-sensitive configurations in software systems with LLM-based agents. Empirical Software Engineering. 2026;31(6). doi:10.1007/s10664-026-10883-7
BibTeX
@article{Wang2026,
author = {Wang, Zehao and Kim, Dong Jae and Chen, Tse-Hsun Peter},
title = {Identifying performance-sensitive configurations in software systems with LLM-based agents},
journal = {Empirical Software Engineering},
year = {2026},
volume = {31},
number = {6},
doi = {10.1007/s10664-026-10883-7}
}
EUVIMED