EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Automatic Construction Hazard Identification Integrating On-Site Scene Graphs with Information Extraction in Outfield Test

Xuan Liu, Xiaochuan Jing, Quan Zhu, Wanru Du, Xiaoyin Wang

Buildings · 29.01.2023 · 13 (2) · 377

DOI: 10.3390/buildings13020377 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Buildings, online erschienen am 29.01.2023. Verfasst von Xuan Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 53 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Aerospace Hongka Intelligent Technology (Beijing) CO., LTD..

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Construction hazards occur at any time in outfield test sites and frequently result from improper interactions between objects. The majority of casualties might be avoided by following on-site regulations. However, workers may be unable to comply with the safety regulations fully because of stress, fatigue, or negligence. The development of deep-learning-based computer vision and on-site video surveillance facilitates safety inspections, but automatic hazard identification is often limited due to the semantic gap. This paper proposes an automatic hazard identification method that integrates on-site scene graph generation and domain-specific knowledge extraction. A BERT-based information extraction model is presented to automatically extract the key regulatory information from outfield work safety requirements. Subsequently, an on-site scene parsing model is introduced for detecting interaction between objects in images. An automatic safety checking approach is also established to perform PPE compliance checks by integrating detected textual and visual relational information. Experimental results show that our proposed method achieves strong performance in various metrics on self-built and widely used public datasets. The proposed method can precisely extract relational information from visual and text modalities to facilitate on-site hazard identification.

Förderung

  • Aerospace Hongka Intelligent Technology (Beijing) CO., LTD.

Zitieren

APA

Liu, X., Jing, X., Zhu, Q., Du, W., & Wang, X. (2023). Automatic Construction Hazard Identification Integrating On-Site Scene Graphs with Information Extraction in Outfield Test. Buildings, 13(2), 377. https://doi.org/10.3390/buildings13020377

Vancouver

Liu X, Jing X, Zhu Q, Du W, Wang X. Automatic Construction Hazard Identification Integrating On-Site Scene Graphs with Information Extraction in Outfield Test. Buildings. 2023;13(2):377. doi:10.3390/buildings13020377

BibTeX
@article{Liu2023,
  author = {Liu, Xuan and Jing, Xiaochuan and Zhu, Quan and Du, Wanru and Wang, Xiaoyin},
  title = {Automatic Construction Hazard Identification Integrating On-Site Scene Graphs with Information Extraction in Outfield Test},
  journal = {Buildings},
  year = {2023},
  volume = {13},
  number = {2},
  pages = {377},
  doi = {10.3390/buildings13020377}
}
Kostenlos starten →