Patterns and Mitigation of Large Language Models’ Hallucinations on Environmental Regulatory Facts
Environmental Science & Technology · 09.11.2026
DOI: 10.1021/acs.est.6c06286 ↗Kurz gefasst
Fachartikel in der Zeitschrift Environmental Science & Technology, online erschienen am 09.11.2026. Verfasst von Jinyue Jiang und 3 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Gefördert von: Arizona State University.
Abstract (Originalsprache)
With increasing adoption of large language models (LLMs) in the environmental education, research, and policy domains, reducing hallucinations─where LLMs confidently produce wrong or fabricated results─remains a critical challenge toward trustworthy agentic AI. We evaluated hallucinations on 505 environmental water, air, and solids regulatory facts collected from U.S., China, the European Union (EU), and the World Health Organization (WHO). Across four open-weight and three commercial state-of-the-art LLMs evaluated in both English and Chinese, open-weight models hallucinated on 50–70% of facts, while commercial models hallucinated on only 7–15%. We discovered a deep geographic and linguistic imbalance, where LLMs hallucinate much less on U.S. facts, and when prompting in English. Although models were less confident on average when hallucinating, a non-trivial fraction of incorrect answers were still produced with high token-level confidence. Causal tracing identified layers where restoring the subject representation most strongly recovered correct answers, with patterns differing across models. Retrieval-augmented generation effectively mitigated hallucination, even for small open-weight models. Safe deployment of AI in high-stakes environmental workflows therefore requires both targeted mitigation of training biases and robust external knowledge grounding.
Förderung
- Arizona State University
Zitieren
APA
Jiang, J., Tian, Y., Tong, T., & Westerhoff, P. (2026). Patterns and Mitigation of Large Language Models’ Hallucinations on Environmental Regulatory Facts. Environmental Science & Technology. https://doi.org/10.1021/acs.est.6c06286
Vancouver
Jiang J, Tian Y, Tong T, Westerhoff P. Patterns and Mitigation of Large Language Models’ Hallucinations on Environmental Regulatory Facts. Environmental Science & Technology. 2026. doi:10.1021/acs.est.6c06286
BibTeX
@article{Jiang2026,
author = {Jiang, Jinyue and Tian, Yanji and Tong, Tiezheng and Westerhoff, Paul},
title = {Patterns and Mitigation of Large Language Models’ Hallucinations on Environmental Regulatory Facts},
journal = {Environmental Science & Technology},
year = {2026},
doi = {10.1021/acs.est.6c06286}
}
EUVIMED