EUVIMEDEUVIMED entdecken
Delphi-StudieOpen Access · CC BY-NC-ND 4.0

Governance risks of AI reasoning in urban infrastructure through Delphi audit of human and large language model judgment

Alence Poudel, Carla Barrios, Paola De La Torre, Huy Ton, Trevor Surface, Varenya Mehta, Samanata Silwal

Discover Cities · 14.05.2026 · 3 (1)

DOI: 10.1007/s44327-026-00268-2 ↗

Kurz gefasst

Delphi-Studie in der Zeitschrift Discover Cities, online erschienen am 14.05.2026. Verfasst von Alence Poudel und 6 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Cities are increasingly considering large language models (LLMs) to support smart city operations and infrastructure decision-making. While these tools promise efficiency, their use in public institutions raises concerns about accountability, reliability, and institutional risk. This study presents a sociotechnical audit of six commercial LLMs by comparing their reasoning with a Delphi-derived rubric constructed from the responses of twenty infrastructure professionals. The Delphi process elicited and refined expert reasoning criteria, producing a rubric that emphasized public safety, regulatory compliance, contextual judgment, financial stewardship, and system reliability. Results show that LLMs often generate responses with the structural clarity associated with early-career engineers, yet they display persistent weaknesses in factual grounding and contextual interpretation. Across all models, 51.3% of cited sources were unverifiable or fabricated, and LLM self-reported confidence was negatively correlated with actual reasoning quality (r = -0.23), meaning the lowest-performing models projected the greatest certainty. Decision alignment with expert judgment degraded as scenario complexity increased, with strong agreement on operational triage but near-complete divergence on strategic capital allocation. Many responses misinterpreted regulatory requirements or relied on shallow justification. These failures extend beyond technical accuracy and introduce risks for governance, fiscal responsibility, and regulatory compliance. Methodologically, the study demonstrates how expert reasoning can be operationalized as a benchmark for evaluating AI systems in urban infrastructure contexts, addressing gaps in empirical assessment and governance tools. The findings carry direct implications for accountability, institutional integrity, and public trust in urban governance, and contribute to ongoing discourse on responsible AI adoption in cities aligned with global sustainability priorities.

Zitieren

APA

Poudel, A., Barrios, C., Torre, P. D. L., Ton, H., Surface, T., Mehta, V., & Silwal, S. (2026). Governance risks of AI reasoning in urban infrastructure through Delphi audit of human and large language model judgment. Discover Cities, 3(1). https://doi.org/10.1007/s44327-026-00268-2

Vancouver

Poudel A, Barrios C, Torre PDL, Ton H, Surface T, Mehta V, et al. Governance risks of AI reasoning in urban infrastructure through Delphi audit of human and large language model judgment. Discover Cities. 2026;3(1). doi:10.1007/s44327-026-00268-2

BibTeX
@article{Poudel2026,
  author = {Poudel, Alence and Barrios, Carla and Torre, Paola De La and Ton, Huy and Surface, Trevor and Mehta, Varenya and Silwal, Samanata},
  title = {Governance risks of AI reasoning in urban infrastructure through Delphi audit of human and large language model judgment},
  journal = {Discover Cities},
  year = {2026},
  volume = {3},
  number = {1},
  doi = {10.1007/s44327-026-00268-2}
}
Kostenlos starten →