CAMA: Enhancing Mathematical Reasoning in Large Language Models with Causal Knowledge
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (41) · 34566-34574
DOI: 10.1609/aaai.v40i41.40756 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Lei Zan und 3 weiteren Autor:innen.
Abstract (Originalsprache)
Large Language Models (LLMs) have demonstrated strong performance across a wide range of tasks, yet they still struggle with complex mathematical reasoning, a challenge fundamentally rooted in deep structural dependencies. To address this challenge, we propose CAusal MAthematician (CAMA), a two stage causal framework that equips LLMs with explicit, reusable mathematical structure. In the learning stage, CAMA first constructs the Mathematical Causal Graph (MCG), a high level representation of solution strategies, by combining LLM priors with causal discovery algorithms applied to a corpus of question solution pairs. The resulting MCG encodes essential knowledge points and their causal dependencies. To better align the graph with downstream reasoning tasks, CAMA further refines the MCG through iterative feedback derived from a selected subset of the question solution pairs. In the reasoning stage, given a new question, CAMA dynamically extracts a task relevant subgraph from the MCG, conditioned on both the question content and the LLM’s intermediate reasoning trace. This subgraph, which encodes the most pertinent knowledge points and their causal dependencies, is then injected back into the LLM to guide its reasoning process. Empirical results on real world datasets show that CAMA significantly improves LLM performance on challenging mathematical problems. Furthermore, our experiments demonstrate that structured guidance consistently outperforms unstructured alternatives, and that incorporating asymmetric causal relationships yields greater improvements than using symmetric associations alone.
Zitieren
APA
Zan, L., Zhang, K., Cai, R., & Pan, L. (2026). CAMA: Enhancing Mathematical Reasoning in Large Language Models with Causal Knowledge. Proceedings of the AAAI Conference on Artificial Intelligence, 40(41), 34566-34574. https://doi.org/10.1609/aaai.v40i41.40756
Vancouver
Zan L, Zhang K, Cai R, Pan L. CAMA: Enhancing Mathematical Reasoning in Large Language Models with Causal Knowledge. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(41):34566-34574. doi:10.1609/aaai.v40i41.40756
BibTeX
@article{Zan2026,
author = {Zan, Lei and Zhang, Keli and Cai, Ruichu and Pan, Lujia},
title = {CAMA: Enhancing Mathematical Reasoning in Large Language Models with Causal Knowledge},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {41},
pages = {34566--34574},
doi = {10.1609/aaai.v40i41.40756}
}
EUVIMED