EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

When Hedging Hides Heterogeneity: A Measurement and Identification Framework for Uncertainty in Large Language Models

Yao Zhao

RSS: Data Science and Artificial Intelligence · 13.11.2026

DOI: 10.1093/rssdat/udag004 ↗

Kurz gefasst

Fachartikel in der Zeitschrift RSS: Data Science and Artificial Intelligence, online erschienen am 13.11.2026. Verfasst von Yao Zhao. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models routinely hedge on contested questions, but the surface uniformity of such hedging conceals a heterogeneous mixture of underlying latent drivers. We distinguish four latent drivers: epistemic uncertainty, hermeneutic openness, alignment-induced policy effects (which can suppress or amplify evaluative stance), and cross-context interpretive divergence. We argue that verbalised output is best understood as a measurement-and-identification problem in which these heterogeneous latent drivers of uncertainty and stance are compressed into a single output channel by a noninjective verbalisation map: similar hedging or balancing language may reflect genuine uncertainty or instead policy and contextual effects, and a user cannot reliably distinguish these drivers from a single output. We formalise this compression, characterise the decision-theoretic regret of conflating drivers whose appropriate downstream interventions differ, and observe that this regret does not vanish under additional factual evidence when the dominant driver is non-epistemic. Empirical claims are anchored in a pre-specified replication study. We then introduce four families of identifying probes, namely factual-evidence augmentation, counterfactual rephrasing, standpoint-conditioned elicitation, and cross-lingual consistency, which provide directional identification of the dominant latent driver of an observed hedge. We close with implications for professional practice in journalism, policy analysis, and comparative research; design principles for uncertainty-disclosure interfaces; and a benchmark proposal for driver-stratified evaluation of LLM uncertainty.

Zitieren

APA

Zhao, Y. (2026). When Hedging Hides Heterogeneity: A Measurement and Identification Framework for Uncertainty in Large Language Models. RSS: Data Science and Artificial Intelligence. https://doi.org/10.1093/rssdat/udag004

Vancouver

Zhao Y. When Hedging Hides Heterogeneity: A Measurement and Identification Framework for Uncertainty in Large Language Models. RSS: Data Science and Artificial Intelligence. 2026. doi:10.1093/rssdat/udag004

BibTeX
@article{Zhao2026,
  author = {Zhao, Yao},
  title = {When Hedging Hides Heterogeneity: A Measurement and Identification Framework for Uncertainty in Large Language Models},
  journal = {RSS: Data Science and Artificial Intelligence},
  year = {2026},
  doi = {10.1093/rssdat/udag004}
}
Kostenlos starten →