Spectrum-Based Failure Attribution for Multi-agent Systems
Proceedings of the ACM on Software Engineering · 30.06.2026 · 3 (FSE) · 1888-1909
DOI: 10.1145/3797113 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 30.06.2026. Verfasst von Yu Ge und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Jiangsu Funding Program for Excellent Postdoctoral Talent.
Abstract (Originalsprache)
Large Language Model Powered Multi-Agent Systems (MASs) are increasingly employed to automate complex real-world tasks, such as programming and scientific discovery. While promising, MASs are not immune to defects or failures. Failure attribution in MASs, i.e., to pinpoint the specific agent actions responsible for failures, is underexplored and labor-intensive, posing significant challenges for debugging and improving MASs. To bridge this gap, we propose FAMAS, the first spectrum-based failure attribution approach for MASs. The approach performs systematic trajectory replay and abstraction, followed by spectrum analysis. Its core idea is to estimate, from variations across repeated MAS executions, the likelihood that each agent action is responsible for the failure. In particular, we propose a novel suspiciousness formula tailored to MASs, which integrates two key factor groups, namely the agent behavior group and the action behavior group, to account for the agent activation patterns and action activation patterns within the MAS execution trajectories. Extensively evaluated against 12 baselines from the Who&When benchmark, FAMAS demonstrates superior performance, outperforming all compared methods.
Förderung
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Jiangsu Funding Program for Excellent Postdoctoral Talent
- Postdoctoral Fellowship Program of CPSF
- Hong Kong Polytechnic University
Zitieren
APA
Ge, Y., Xie, L., Li, Z., Pei, Y., & Zhang, T. (2026). Spectrum-Based Failure Attribution for Multi-agent Systems. Proceedings of the ACM on Software Engineering, 3(FSE), 1888-1909. https://doi.org/10.1145/3797113
Vancouver
Ge Y, Xie L, Li Z, Pei Y, Zhang T. Spectrum-Based Failure Attribution for Multi-agent Systems. Proceedings of the ACM on Software Engineering. 2026;3(FSE):1888-1909. doi:10.1145/3797113
BibTeX
@article{Ge2026,
author = {Ge, Yu and Xie, Linna and Li, Zhong and Pei, Yu and Zhang, Tian},
title = {Spectrum-Based Failure Attribution for Multi-agent Systems},
journal = {Proceedings of the ACM on Software Engineering},
year = {2026},
volume = {3},
number = {FSE},
pages = {1888--1909},
doi = {10.1145/3797113}
}
EUVIMED