EUVIMEDEUVIMED entdecken
Crossref

Concept-RuleNet: Grounded Multi-Agent Neurosymbolic Reasoning in Vision Language Models

Sanchit Sinha, Guangzhi Xiong, Zhenghao He, Aidong Zhang

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (35) · 29678-29686

DOI: 10.1609/aaai.v40i35.40212 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Sanchit Sinha und 3 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Modern vision-language models (VLMs) deliver impressive predictive accuracy yet offer little insight into 'why' a decision is reached, frequently hallucinating facts, particularly when encountering out-of-distribution data. Neurosymbolic frameworks address this by pairing black-box perception with interpretable symbolic reasoning, but current methods extract their symbols solely from task labels, leaving them weakly grounded in the underlying visual data. In this paper, we introduce a multi-agent system - Concept-RuleNet that reinstates visual grounding while retaining transparent reasoning. Specifically, a multimodal concept generator first mines discriminative visual concepts directly from a representative subset of training images. Next, these visual concepts are utilized to condition symbol discovery, anchoring the generations in real image statistics and mitigating label bias. Subsequently, symbols are composed into executable first-order rules by a large language model reasoner agent - yielding interpretable neurosymbolic rules. Finally, during inference, a vision verifier agent quantifies the degree of presence of each symbol and triggers rule execution in tandem with outputs of black-box neural models, predictions with explicit reasoning pathways. Experiments on five benchmarks, including two challenging medical-imaging tasks and three underrepresented natural-image datasets, show that our system augments state-of-the-art neurosymbolic baselines by an average of 5% while also reducing the occurrence of hallucinated symbols in rules by up to 50%.

Zitieren

APA

Sinha, S., Xiong, G., He, Z., & Zhang, A. (2026). Concept-RuleNet: Grounded Multi-Agent Neurosymbolic Reasoning in Vision Language Models. Proceedings of the AAAI Conference on Artificial Intelligence, 40(35), 29678-29686. https://doi.org/10.1609/aaai.v40i35.40212

Vancouver

Sinha S, Xiong G, He Z, Zhang A. Concept-RuleNet: Grounded Multi-Agent Neurosymbolic Reasoning in Vision Language Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(35):29678-29686. doi:10.1609/aaai.v40i35.40212

BibTeX
@article{Sinha2026,
  author = {Sinha, Sanchit and Xiong, Guangzhi and He, Zhenghao and Zhang, Aidong},
  title = {Concept-RuleNet: Grounded Multi-Agent Neurosymbolic Reasoning in Vision Language Models},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {35},
  pages = {29678--29686},
  doi = {10.1609/aaai.v40i35.40212}
}
Kostenlos starten →