Fine-grained Uncertainty Decomposition in Large Language Models: A Spectral Approach
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (31) · 26090-26098
DOI: 10.1609/aaai.v40i31.39811 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Nassim Walha und 6 weiteren Autor:innen.
Abstract (Originalsprache)
As Large Language Models (LLMs) are increasingly integrated in diverse applications, obtaining reliable measures of their predictive uncertainty has become critically important. A precise distinction between aleatoric uncertainty, arising from inherent ambiguities within input data, and epistemic uncertainty, originating exclusively from model limitations, is essential to effectively address each uncertainty source. In this paper, we introduce Spectral Uncertainty, a novel approach to quantifying and decomposing uncertainties in LLMs. Leveraging the Von Neumann entropy from quantum information theory, Spectral Uncertainty provides a rigorous theoretical foundation for separating total uncertainty into distinct aleatoric and epistemic components. Unlike existing baseline methods, our approach incorporates a fine-grained representation of semantic similarity, enabling nuanced differentiation among various semantic interpretations in model responses. Empirical evaluations demonstrate that Spectral Uncertainty outperforms state-of-the-art methods in estimating both aleatoric and total uncertainty across diverse models and benchmark datasets.
Zitieren
APA
Walha, N., Gruber, S. G., Decker, T., Yang, Y., Javanmardi, A., Hüllermeier, E., & Buettner, F. (2026). Fine-grained Uncertainty Decomposition in Large Language Models: A Spectral Approach. Proceedings of the AAAI Conference on Artificial Intelligence, 40(31), 26090-26098. https://doi.org/10.1609/aaai.v40i31.39811
Vancouver
Walha N, Gruber SG, Decker T, Yang Y, Javanmardi A, Hüllermeier E, et al. Fine-grained Uncertainty Decomposition in Large Language Models: A Spectral Approach. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(31):26090-26098. doi:10.1609/aaai.v40i31.39811
BibTeX
@article{Walha2026,
author = {Walha, Nassim and Gruber, Sebastian G. and Decker, Thomas and Yang, Yinchong and Javanmardi, Alireza and Hüllermeier, Eyke and Buettner, Florian},
title = {Fine-grained Uncertainty Decomposition in Large Language Models: A Spectral Approach},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {31},
pages = {26090--26098},
doi = {10.1609/aaai.v40i31.39811}
}
EUVIMED