When Hedging Hides Heterogeneity: A Measurement and Identification Framework for Uncertainty in Large Language Models
RSS: Data Science and Artificial Intelligence · 13.11.2026
DOI: 10.1093/rssdat/udag004 ↗Kurz gefasst
Fachartikel in der Zeitschrift RSS: Data Science and Artificial Intelligence, online erschienen am 13.11.2026. Verfasst von Yao Zhao. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Large language models routinely hedge on contested questions, but the surface uniformity of such hedging conceals a heterogeneous mixture of underlying latent drivers. We distinguish four latent drivers: epistemic uncertainty, hermeneutic openness, alignment-induced policy effects (which can suppress or amplify evaluative stance), and cross-context interpretive divergence. We argue that verbalised output is best understood as a measurement-and-identification problem in which these heterogeneous latent drivers of uncertainty and stance are compressed into a single output channel by a noninjective verbalisation map: similar hedging or balancing language may reflect genuine uncertainty or instead policy and contextual effects, and a user cannot reliably distinguish these drivers from a single output. We formalise this compression, characterise the decision-theoretic regret of conflating drivers whose appropriate downstream interventions differ, and observe that this regret does not vanish under additional factual evidence when the dominant driver is non-epistemic. Empirical claims are anchored in a pre-specified replication study. We then introduce four families of identifying probes, namely factual-evidence augmentation, counterfactual rephrasing, standpoint-conditioned elicitation, and cross-lingual consistency, which provide directional identification of the dominant latent driver of an observed hedge. We close with implications for professional practice in journalism, policy analysis, and comparative research; design principles for uncertainty-disclosure interfaces; and a benchmark proposal for driver-stratified evaluation of LLM uncertainty.
Zitieren
APA
Zhao, Y. (2026). When Hedging Hides Heterogeneity: A Measurement and Identification Framework for Uncertainty in Large Language Models. RSS: Data Science and Artificial Intelligence. https://doi.org/10.1093/rssdat/udag004
Vancouver
Zhao Y. When Hedging Hides Heterogeneity: A Measurement and Identification Framework for Uncertainty in Large Language Models. RSS: Data Science and Artificial Intelligence. 2026. doi:10.1093/rssdat/udag004
BibTeX
@article{Zhao2026,
author = {Zhao, Yao},
title = {When Hedging Hides Heterogeneity: A Measurement and Identification Framework for Uncertainty in Large Language Models},
journal = {RSS: Data Science and Artificial Intelligence},
year = {2026},
doi = {10.1093/rssdat/udag004}
}
EUVIMED