KisMATH: Do LLMs Have Knowledge of Implicit Structures in Mathematical Reasoning?
Transactions of the Association for Computational Linguistics · 01.07.2026 · 14 · 1308-1328
DOI: 10.1162/tacl.a.729 ↗Kurz gefasst
Fachartikel in der Zeitschrift Transactions of the Association for Computational Linguistics, online erschienen am 01.07.2026. Verfasst von Soumadeep Saha und 4 weiteren Autor:innen. Die Arbeit nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Chain-of-thought (CoT) traces have been shown to improve performance of large language models on a plethora of reasoning tasks, yet there is no consensus on the mechanism by which this boost is achieved. To shed more light on this, we introduce Causal CoT Graphs (CCGraphs), which are directed acyclic graphs automatically extracted from reasoning traces that model finegrained causal dependencies in language-model outputs. A collection of 1671 mathematical reasoning problems from MATH500, GSM8K, and AIME, together with their associated CCGraphs, has been compiled into our dataset—KisMATH. Our detailed empirical analysis with 15 open-weight LLMs shows that (i) reasoning nodes in the CCGraphs are causal contributors to the final answer, which we argue is constitutive of reasoning; and (ii) LLMs emphasize the reasoning paths captured by the CCGraphs, indicating that the models internally realize structures similar to our graphs. KisMATH enables controlled, graph-aligned interventions and opens avenues for further investigation into the role of CoT in LLM reasoning.
Zitieren
APA
Saha, S., Chaturvedi, A., Saha, S., Garain, U., & Asher, N. (2026). KisMATH: Do LLMs Have Knowledge of Implicit Structures in Mathematical Reasoning?. Transactions of the Association for Computational Linguistics, 14, 1308-1328. https://doi.org/10.1162/tacl.a.729
Vancouver
Saha S, Chaturvedi A, Saha S, Garain U, Asher N. KisMATH: Do LLMs Have Knowledge of Implicit Structures in Mathematical Reasoning?. Transactions of the Association for Computational Linguistics. 2026;14:1308-1328. doi:10.1162/tacl.a.729
BibTeX
@article{Saha2026,
author = {Saha, Soumadeep and Chaturvedi, Akshay and Saha, Saptarshi and Garain, Utpal and Asher, Nicholas},
title = {KisMATH: Do LLMs Have Knowledge of Implicit Structures in Mathematical Reasoning?},
journal = {Transactions of the Association for Computational Linguistics},
year = {2026},
volume = {14},
pages = {1308--1328},
doi = {10.1162/tacl.a.729}
}
EUVIMED