EUVIMEDEUVIMED entdecken
Crossref

When the Chain Breaks: Interactive Diagnosis of LLM Chain‐of‐Thought Reasoning Errors

Shiwei Chen, Niruthikka Sritharan, Xiaolin Wen, Chenxi Zhang, Xingbo Wang, Yong Wang

Computer Graphics Forum · 04.06.2026

DOI: 10.1111/cgf.70439 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Graphics Forum, online erschienen am 04.06.2026. Verfasst von Shiwei Chen und 5 weiteren Autor:innen. Die Arbeit nennt 51 Literaturangaben. Gefördert von: Ministry of Education - Singapore, Nottingham Trent University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Current Large Language Models (LLMs), especially Large Reasoning Models, can generate Chain‐of‐Thought (CoT) reasoning traces to illustrate how they produce final outputs, thereby facilitating trust calibration for users. However, these CoT reasoning traces are usually lengthy and tedious, and can contain various issues, such as logical and factual errors, which make it difficult for users to interpret the reasoning traces efficiently and accurately. To address these challenges, we develop an error detection pipeline that combines external fact‐checking with symbolic formal logical validation to identify errors at the step level. Building on this pipeline, we propose ReasonDiag, an interactive visualization system for diagnosing CoT reasoning traces. ReasonDiag provides 1) an integrated arc diagram to show reasoning‐step distributions and error‐propagation patterns, and 2) a hierarchical node‐link diagram to visualize high‐level reasoning flows and premise dependencies. We evaluate Reason‐Diag through a technical evaluation for the error detection pipeline, two case studies, and user interviews with 16 participants. The results indicate that ReasonDiag helps users effectively understand CoT reasoning traces, identify erroneous steps, and determine their root causes.

Förderung

  • Ministry of Education - Singapore
  • Nottingham Trent University

Zitieren

APA

Chen, S., Sritharan, N., Wen, X., Zhang, C., Wang, X., & Wang, Y. (2026). When the Chain Breaks: Interactive Diagnosis of LLM Chain‐of‐Thought Reasoning Errors. Computer Graphics Forum. https://doi.org/10.1111/cgf.70439

Vancouver

Chen S, Sritharan N, Wen X, Zhang C, Wang X, Wang Y. When the Chain Breaks: Interactive Diagnosis of LLM Chain‐of‐Thought Reasoning Errors. Computer Graphics Forum. 2026. doi:10.1111/cgf.70439

BibTeX
@article{Chen2026,
  author = {Chen, Shiwei and Sritharan, Niruthikka and Wen, Xiaolin and Zhang, Chenxi and Wang, Xingbo and Wang, Yong},
  title = {When the Chain Breaks: Interactive Diagnosis of LLM Chain‐of‐Thought Reasoning Errors},
  journal = {Computer Graphics Forum},
  year = {2026},
  doi = {10.1111/cgf.70439}
}
Kostenlos starten →