EUVIMEDScopri EUVIMED
Crossref

A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions

Ola Shorinwa, Zhiting Mei, Justin Lidard, Allen Z. Ren, Anirudha Majumdar

ACM Computing Surveys · 2026-02-28 · 58 (3) · 1-38

DOI: 10.1145/3744238 ↗

At a glance

Journal article in ACM Computing Surveys, published online on 2025-09-09. Written by Ola Shorinwa and 4 co-authors. Cited 61 times so far (Crossref); 255 references. Funded by: NSF CAREER Award, Office of Naval Research, Sloan Fellowship.

AbstractDati bibliograficiCiteRelated studies

Abstract (original language)

The remarkable performance of large language models (LLMs) in content generation, coding, and common-sense reasoning has spurred widespread integration into many facets of society. However, integration of LLMs raises valid questions on their reliability and trustworthiness, given their propensity to generate hallucinations: plausible, factually-incorrect responses, which are expressed with striking confidence. Previous work has shown that hallucinations and other non-factual responses generated by LLMs can be detected by examining the uncertainty of the LLM in its response to the pertinent prompt, driving significant research efforts devoted to quantifying the uncertainty of LLMs. This survey seeks to provide an extensive review of existing uncertainty quantification methods for LLMs, identifying their salient features, along with their strengths and weaknesses. We present existing methods within a relevant taxonomy, unifying ostensibly disparate methods to aid understanding of the state-of-the-art. Furthermore, we highlight applications of uncertainty quantification methods for LLMs, spanning chatbot and textual applications to embodied artificial intelligence applications in robotics. We conclude with open research challenges in the uncertainty quantification of LLMs, seeking to motivate future research.

Funding

  • NSF CAREER Award
  • Office of Naval Research
  • Sloan Fellowship
  • National Science Foundation Graduate Research Fellowship

Cite

APA

Shorinwa, O., Mei, Z., Lidard, J., Ren, A. Z., & Majumdar, A. (2026). A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions. ACM Computing Surveys, 58(3), 1-38. https://doi.org/10.1145/3744238

Vancouver

Shorinwa O, Mei Z, Lidard J, Ren AZ, Majumdar A. A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions. ACM Computing Surveys. 2026;58(3):1-38. doi:10.1145/3744238

BibTeX
@article{Shorinwa2026,
  author = {Shorinwa, Ola and Mei, Zhiting and Lidard, Justin and Ren, Allen Z. and Majumdar, Anirudha},
  title = {A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions},
  journal = {ACM Computing Surveys},
  year = {2026},
  volume = {58},
  number = {3},
  pages = {1--38},
  doi = {10.1145/3744238}
}
Start for free →