Global-Local Confidence Fusion for Hallucination Detection in Mathematical Reasoning Task
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (41) · 34620-34628
DOI: 10.1609/aaai.v40i41.40762 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Bo Zhang und 10 weiteren Autor:innen.
Abstract (Originalsprache)
Large Reasoning Models (LRMs) achieve promising results on complex reasoning tasks but remain susceptible to hallucinations. Existing hallucination detection methods based on Large Language Models (LLMs) often focus solely on final answers, overlooking inconsistencies between the answer and reasoning process. This limitation reduces their ability to detect hallucinations during inference. Moreover, training-free approaches lack mechanisms for confidence estimation, resulting in an unquantified detection output. In contrast, training-based methods can provide fine-grained assessments but often neglect the self-correction capability of LRMs, where earlier errors may be corrected in subsequent steps, leading to inaccurate hallucination detection. To address these challenges, we propose ConfFuse, a unified framework that fuses global and local confidence scores for hallucination detection. A Global Hallucination Detection Model (GHDM) is trained using Direct Preference Optimization (DPO) to assess hallucinations at the level of entire reasoning chains, yielding global confidence estimates. Simultaneously, a Process Reward Model (PRM) estimates step-wise confidence scores to capture local logical flaws. A weighted fusion strategy combines the global confidence score with the minimum local score to jointly reflect overall reasoning consistency and local soundness. Experimental evaluations demonstrate that ConfFuse surpasses Qwen3-1.7B and Qwen3-8B by up to 11.86% and 5.46% in F1 score on in-distribution datasets, and achieves average improvements of 4.65% and 2.80% on out-of-distribution datasets. These results verify the effectiveness and generalizability of the proposed framework.
Zitieren
APA
Zhang, B., Gao, C., Yang, L., Han, B., Hu, M., Luo, Z., Geng, G., Bai, X., Zhang, J., Yao, W., & Wang, Z. (2026). Global-Local Confidence Fusion for Hallucination Detection in Mathematical Reasoning Task. Proceedings of the AAAI Conference on Artificial Intelligence, 40(41), 34620-34628. https://doi.org/10.1609/aaai.v40i41.40762
Vancouver
Zhang B, Gao C, Yang L, Han B, Hu M, Luo Z, et al. Global-Local Confidence Fusion for Hallucination Detection in Mathematical Reasoning Task. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(41):34620-34628. doi:10.1609/aaai.v40i41.40762
BibTeX
@article{Zhang2026,
author = {Zhang, Bo and Gao, Cong and Yang, Linkang and Han, Bingxu and Hu, Minghao and Luo, Zhunchen and Geng, Guotong and Bai, Xiaoying and Zhang, Jun and Yao, Wen and Wang, Zhong},
title = {Global-Local Confidence Fusion for Hallucination Detection in Mathematical Reasoning Task},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {41},
pages = {34620--34628},
doi = {10.1609/aaai.v40i41.40762}
}
EUVIMED