EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Is vibe coding the future? An empirical assessment of LLM generated codes for construction safety

S M Jamil Uddin

Journal of Information Technology in Construction · 17.11.2026 · 31 · 1434

DOI: 10.36680/j.itcon.2026.058 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Information Technology in Construction, online erschienen am 17.11.2026. Verfasst von S M Jamil Uddin. Die Arbeit nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The emergence of vibe coding, a paradigm where non-technical users instruct Large Language Models (LLMs) to generate executable codes via natural language, presents both opportunities and risks for the construction industry. While empowering construction personnel such as the safety managers, foremen, and workers to develop tools and software, the probabilistic nature of LLMs introduces the threat of silent failures, wherein generated code compiles runs without error but executes flawed mathematical safety logic. This study empirically evaluates the reliability, software architecture, and domain-specific safety fidelity of 450 vibe-coded Python scripts generated by three frontier models, Claude 3.5 Haiku, GPT-4o-Mini, and Gemini 2.5 Flash. Utilizing a persona-driven prompt dataset (n=150) and a bifurcated evaluation pipeline comprising isolated dynamic sandboxing and an LLM-as-a-Judge, the research quantifies the limits of zero-shot vibe codes for construction safety. The findings show a statistically significant association of moderate strength between user persona and data hallucination; the generated tools invented missing safety variables more often for the less formal and less specific prompts of the field personas. Furthermore, while the models demonstrated high foundational execution viability (~85%), execution success did not indicate correct logic, and error handling was present in only 16% of scripts. Among successfully executed scripts, the study identified an ~45% overall Silent Failure Rate, with GPT-4o-Mini generating mathematically inaccurate outputs in ~56% of its functional code. The results indicate that the evaluated LLMs, used without safeguards, do not provide the deterministic reliability required for standalone safety engineering. For construction practice, they indicate that ungoverned vibe-coded tools threaten site-level safety decision-making and digital compliance workflows, and that safe adoption requires embedding LLMs within deterministic, pre-validated calculation engines under explicit organizational governance of AI-generated tools.

Zitieren

APA

Uddin, S. M. J. (2026). Is vibe coding the future? An empirical assessment of LLM generated codes for construction safety. Journal of Information Technology in Construction, 31, 1434. https://doi.org/10.36680/j.itcon.2026.058

Vancouver

Uddin SMJ. Is vibe coding the future? An empirical assessment of LLM generated codes for construction safety. Journal of Information Technology in Construction. 2026;31:1434. doi:10.36680/j.itcon.2026.058

BibTeX
@article{Uddin2026,
  author = {Uddin, S M Jamil},
  title = {Is vibe coding the future? An empirical assessment of LLM generated codes for construction safety},
  journal = {Journal of Information Technology in Construction},
  year = {2026},
  volume = {31},
  pages = {1434},
  doi = {10.36680/j.itcon.2026.058}
}
Kostenlos starten →