EUVIMEDEUVIMED entdecken
Crossref

Global-Local Confidence Fusion for Hallucination Detection in Mathematical Reasoning Task

Bo Zhang, Cong Gao, Linkang Yang, Bingxu Han, Minghao Hu, Zhunchen Luo, Guotong Geng, Xiaoying Bai, Jun Zhang, Wen Yao, Zhong Wang

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (41) · 34620-34628

DOI: 10.1609/aaai.v40i41.40762 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Bo Zhang und 10 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Reasoning Models (LRMs) achieve promising results on complex reasoning tasks but remain susceptible to hallucinations. Existing hallucination detection methods based on Large Language Models (LLMs) often focus solely on final answers, overlooking inconsistencies between the answer and reasoning process. This limitation reduces their ability to detect hallucinations during inference. Moreover, training-free approaches lack mechanisms for confidence estimation, resulting in an unquantified detection output. In contrast, training-based methods can provide fine-grained assessments but often neglect the self-correction capability of LRMs, where earlier errors may be corrected in subsequent steps, leading to inaccurate hallucination detection. To address these challenges, we propose ConfFuse, a unified framework that fuses global and local confidence scores for hallucination detection. A Global Hallucination Detection Model (GHDM) is trained using Direct Preference Optimization (DPO) to assess hallucinations at the level of entire reasoning chains, yielding global confidence estimates. Simultaneously, a Process Reward Model (PRM) estimates step-wise confidence scores to capture local logical flaws. A weighted fusion strategy combines the global confidence score with the minimum local score to jointly reflect overall reasoning consistency and local soundness. Experimental evaluations demonstrate that ConfFuse surpasses Qwen3-1.7B and Qwen3-8B by up to 11.86% and 5.46% in F1 score on in-distribution datasets, and achieves average improvements of 4.65% and 2.80% on out-of-distribution datasets. These results verify the effectiveness and generalizability of the proposed framework.

Zitieren

APA

Zhang, B., Gao, C., Yang, L., Han, B., Hu, M., Luo, Z., Geng, G., Bai, X., Zhang, J., Yao, W., & Wang, Z. (2026). Global-Local Confidence Fusion for Hallucination Detection in Mathematical Reasoning Task. Proceedings of the AAAI Conference on Artificial Intelligence, 40(41), 34620-34628. https://doi.org/10.1609/aaai.v40i41.40762

Vancouver

Zhang B, Gao C, Yang L, Han B, Hu M, Luo Z, et al. Global-Local Confidence Fusion for Hallucination Detection in Mathematical Reasoning Task. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(41):34620-34628. doi:10.1609/aaai.v40i41.40762

BibTeX
@article{Zhang2026,
  author = {Zhang, Bo and Gao, Cong and Yang, Linkang and Han, Bingxu and Hu, Minghao and Luo, Zhunchen and Geng, Guotong and Bai, Xiaoying and Zhang, Jun and Yao, Wen and Wang, Zhong},
  title = {Global-Local Confidence Fusion for Hallucination Detection in Mathematical Reasoning Task},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {41},
  pages = {34620--34628},
  doi = {10.1609/aaai.v40i41.40762}
}
Kostenlos starten →