Defining and Detecting the Defects of Large Language Model-Based Autonomous Agents
IEEE Transactions on Software Engineering · 2026-03 · 52 (3) · 1074-1093
DOI: 10.1109/tse.2026.3658554 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Software Engineering, 2026-03. Verfasst von Kaiwen Ning und 7 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 81 Literaturangaben. Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, Major Key Project of Pengcheng Laboratory.
Abstract (Originalsprache)
Artificial intelligence (AI) agents are systems capable of perceiving their environment, autonomously planning and executing tasks. Recent advancements in Large Language Models (LLMs) have introduced a transformative paradigm for AI agents, enabling them to interact with external resources and tools through prompt techniques. This advancement has significantly extended the capabilities of LLMs, positioning LLM-based AI Agents as an important research area. In such agents, the workflow integrates developer-written code, which manages framework construction and logic control, with LLM-generated natural language that enhances dynamic decision-making and interaction. However, inconsistencies between LLM outputs and developer logic can lead to defects, such as tool invocation failures. These issues introduce specific risks, leading to various defects in LLM-based AI Agents, including service interruptions and incorrect output. Despite the importance of these issues, there is a lack of systematic work that focuses on analyzing LLM-based AI Agents to uncover defects in their code. To address this gap, we present the first study focused on identifying and detecting defects in LLM Agents. We collected and analyzed 14,754 relevant developer reports from StackOverflow and GitHub. We further filtered 2,604 valid posts to define and classify eight types of agent code defects. Then, we designed a static analysis tool, named Agentable, to detect these defects. Agentable leverages Code Property Graphs (CPGs) and LLMs to analyze Agent workflows by efficiently identifying specific code patterns and analyzing natural language descriptions. To evaluate Agentable, we constructed two datasets: AgentSet, which consists of 84 real-world Agent projects, and AgentTest, which contains 78 Agent projects specifically designed to include various types of defects. Our evaluation shows that Agentable achieves a precision of $88.79\%$ 88.79 % on the real-world agent dataset and a recall of $91.03\%$ 91.03 % on the manually labeled defect dataset. Furthermore, our analysis identifies 889 defects in real-world agent projects, highlighting the prevalence of these issues in practice.
Förderung
- National Key R&D Program of China
- National Natural Science Foundation of China
- Major Key Project of Pengcheng Laboratory
Zitieren
APA
Ning, K., Chen, J., Zhang, J., Li, W., Wang, Z., Feng, Y., Zhang, W., & Zheng, Z. (2026). Defining and Detecting the Defects of Large Language Model-Based Autonomous Agents. IEEE Transactions on Software Engineering, 52(3), 1074-1093. https://doi.org/10.1109/tse.2026.3658554
Vancouver
Ning K, Chen J, Zhang J, Li W, Wang Z, Feng Y, et al. Defining and Detecting the Defects of Large Language Model-Based Autonomous Agents. IEEE Transactions on Software Engineering. 2026;52(3):1074-1093. doi:10.1109/tse.2026.3658554
BibTeX
@article{Ning2026,
author = {Ning, Kaiwen and Chen, Jiachi and Zhang, Jingwen and Li, Wei and Wang, Zexu and Feng, Yuming and Zhang, Weizhe and Zheng, Zibin},
title = {Defining and Detecting the Defects of Large Language Model-Based Autonomous Agents},
journal = {IEEE Transactions on Software Engineering},
year = {2026},
volume = {52},
number = {3},
pages = {1074--1093},
doi = {10.1109/tse.2026.3658554}
}
EUVIMED