When the Chain Breaks: Interactive Diagnosis of LLM Chain‐of‐Thought Reasoning Errors
Computer Graphics Forum · 04.06.2026
DOI: 10.1111/cgf.70439 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 04.06.2026. Verfasst von Shiwei Chen und 5 weiteren Autor:innen. Die Arbeit nennt 51 Literaturangaben. Gefördert von: Ministry of Education - Singapore, Nottingham Trent University.
Abstract (Originalsprache)
Current Large Language Models (LLMs), especially Large Reasoning Models, can generate Chain‐of‐Thought (CoT) reasoning traces to illustrate how they produce final outputs, thereby facilitating trust calibration for users. However, these CoT reasoning traces are usually lengthy and tedious, and can contain various issues, such as logical and factual errors, which make it difficult for users to interpret the reasoning traces efficiently and accurately. To address these challenges, we develop an error detection pipeline that combines external fact‐checking with symbolic formal logical validation to identify errors at the step level. Building on this pipeline, we propose ReasonDiag, an interactive visualization system for diagnosing CoT reasoning traces. ReasonDiag provides 1) an integrated arc diagram to show reasoning‐step distributions and error‐propagation patterns, and 2) a hierarchical node‐link diagram to visualize high‐level reasoning flows and premise dependencies. We evaluate Reason‐Diag through a technical evaluation for the error detection pipeline, two case studies, and user interviews with 16 participants. The results indicate that ReasonDiag helps users effectively understand CoT reasoning traces, identify erroneous steps, and determine their root causes.
Förderung
- Ministry of Education - Singapore
- Nottingham Trent University
Zitieren
APA
Chen, S., Sritharan, N., Wen, X., Zhang, C., Wang, X., & Wang, Y. (2026). When the Chain Breaks: Interactive Diagnosis of LLM Chain‐of‐Thought Reasoning Errors. Computer Graphics Forum. https://doi.org/10.1111/cgf.70439
Vancouver
Chen S, Sritharan N, Wen X, Zhang C, Wang X, Wang Y. When the Chain Breaks: Interactive Diagnosis of LLM Chain‐of‐Thought Reasoning Errors. Computer Graphics Forum. 2026. doi:10.1111/cgf.70439
BibTeX
@article{Chen2026,
author = {Chen, Shiwei and Sritharan, Niruthikka and Wen, Xiaolin and Zhang, Chenxi and Wang, Xingbo and Wang, Yong},
title = {When the Chain Breaks: Interactive Diagnosis of LLM Chain‐of‐Thought Reasoning Errors},
journal = {Computer Graphics Forum},
year = {2026},
doi = {10.1111/cgf.70439}
}
EUVIMED