EUVIMEDEUVIMED entdecken
Crossref

CAMA: Enhancing Mathematical Reasoning in Large Language Models with Causal Knowledge

Lei Zan, Keli Zhang, Ruichu Cai, Lujia Pan

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (41) · 34566-34574

DOI: 10.1609/aaai.v40i41.40756 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Lei Zan und 3 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) have demonstrated strong performance across a wide range of tasks, yet they still struggle with complex mathematical reasoning, a challenge fundamentally rooted in deep structural dependencies. To address this challenge, we propose CAusal MAthematician (CAMA), a two stage causal framework that equips LLMs with explicit, reusable mathematical structure. In the learning stage, CAMA first constructs the Mathematical Causal Graph (MCG), a high level representation of solution strategies, by combining LLM priors with causal discovery algorithms applied to a corpus of question solution pairs. The resulting MCG encodes essential knowledge points and their causal dependencies. To better align the graph with downstream reasoning tasks, CAMA further refines the MCG through iterative feedback derived from a selected subset of the question solution pairs. In the reasoning stage, given a new question, CAMA dynamically extracts a task relevant subgraph from the MCG, conditioned on both the question content and the LLM’s intermediate reasoning trace. This subgraph, which encodes the most pertinent knowledge points and their causal dependencies, is then injected back into the LLM to guide its reasoning process. Empirical results on real world datasets show that CAMA significantly improves LLM performance on challenging mathematical problems. Furthermore, our experiments demonstrate that structured guidance consistently outperforms unstructured alternatives, and that incorporating asymmetric causal relationships yields greater improvements than using symmetric associations alone.

Zitieren

APA

Zan, L., Zhang, K., Cai, R., & Pan, L. (2026). CAMA: Enhancing Mathematical Reasoning in Large Language Models with Causal Knowledge. Proceedings of the AAAI Conference on Artificial Intelligence, 40(41), 34566-34574. https://doi.org/10.1609/aaai.v40i41.40756

Vancouver

Zan L, Zhang K, Cai R, Pan L. CAMA: Enhancing Mathematical Reasoning in Large Language Models with Causal Knowledge. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(41):34566-34574. doi:10.1609/aaai.v40i41.40756

BibTeX
@article{Zan2026,
  author = {Zan, Lei and Zhang, Keli and Cai, Ruichu and Pan, Lujia},
  title = {CAMA: Enhancing Mathematical Reasoning in Large Language Models with Causal Knowledge},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {41},
  pages = {34566--34574},
  doi = {10.1609/aaai.v40i41.40756}
}
Kostenlos starten →