EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Exploring a Multimodal Conversational Agent for Construction Site Safety: A Low-Code Approach to Hazard Detection and Compliance Assessment

Giancarlo de Marco, Elias Niederwieser, Dietmar Siegele

Buildings · 16.09.2025 · 15 (18) · 3352

DOI: 10.3390/buildings15183352 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Buildings, online erschienen am 16.09.2025. Verfasst von Giancarlo de Marco und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Department of Innovation, Research, University and Museums of the Autonomous Province of Bozen/Bolzano.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper discusses the viability of using a low-code multimodal large language model agent with computer vision functionality to support occupational safety and health evaluations on construction sites. The central hypothesis aims to verify that these systems can provide reliable answers, as evaluated against a ground truth review, including the identification of high-risk dangers. A conversational agent was given the task of finding hazards and checking for national legislative compliance within a dataset of 100 real-world construction photos. The comparison of the agent’s results to the ground truth provides insight into current limitations. The primary issues identified were inconsistent taxonomies, inadequate causal reasoning, and insufficient contextual consideration, all of which adversely impacted performance—particularly when analyzing low-resolution images. The metrics supporting the conclusion synthesize that this tool is a valuable augmentation technology, enhancing safety evaluations while still requiring human supervision to ensure reliability.

Förderung

  • Department of Innovation, Research, University and Museums of the Autonomous Province of Bozen/Bolzano

Zitieren

APA

Marco, G. D., Niederwieser, E., & Siegele, D. (2025). Exploring a Multimodal Conversational Agent for Construction Site Safety: A Low-Code Approach to Hazard Detection and Compliance Assessment. Buildings, 15(18), 3352. https://doi.org/10.3390/buildings15183352

Vancouver

Marco GD, Niederwieser E, Siegele D. Exploring a Multimodal Conversational Agent for Construction Site Safety: A Low-Code Approach to Hazard Detection and Compliance Assessment. Buildings. 2025;15(18):3352. doi:10.3390/buildings15183352

BibTeX
@article{Marco2025,
  author = {Marco, Giancarlo de and Niederwieser, Elias and Siegele, Dietmar},
  title = {Exploring a Multimodal Conversational Agent for Construction Site Safety: A Low-Code Approach to Hazard Detection and Compliance Assessment},
  journal = {Buildings},
  year = {2025},
  volume = {15},
  number = {18},
  pages = {3352},
  doi = {10.3390/buildings15183352}
}
Kostenlos starten →