Construction Safety Hazard Identification and Corrective Action Generation Based on a Fine-Tuned Vision–Language Model
Buildings · 11.11.2026 · 16 (22) · 4498
DOI: 10.3390/buildings16224498 ↗Kurz gefasst
Fachartikel in der Zeitschrift Buildings, online erschienen am 11.11.2026. Verfasst von Yiyi Ye und 2 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
To address the limited ability of general-purpose large vision–language models (VLMs) to identify construction safety hazards and the poor integration of identification results with corrective actions, this study proposes a method for construction safety hazard identification and corrective action generation using a fine-tuned VLM. For model training, an image-text dataset covering 11 categories of unsafe behaviors and 10 categories of unsafe physical conditions is established. Qwen3-VL-8B-Instruct was used as the base model for domain-specific fine-tuning with low-rank adaptation (Lo-RA). Combined with structured prompts, the fine-tuned model automatically identifies multiple categories of safety hazards and generates corresponding corrective actions conditioned on the identification results, establishing an integrated workflow for intelligent hazard identification and automated corrective action recommendation. The fine-tuning updates merely around 0.2532% of all model parameters. Under this setting, the model reaches mean per-category precision, recall and F1 values of 0.890, 0.842 and 0.861, respectively. The model showed marked improvements in identifying hazards involving inadequate personal protection and missing safety facilities. Still, it struggles to separate visually similar hazard classes and interpret complicated site scenes. By linking hazard labels, corrective actions and supporting standards, the proposed method converts image-based identification results into structured content for preparing corrective action documentation, providing intelligent support for construction site inspections.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Ye, Y., Luo, Q., & Zhao, T. (2026). Construction Safety Hazard Identification and Corrective Action Generation Based on a Fine-Tuned Vision–Language Model. Buildings, 16(22), 4498. https://doi.org/10.3390/buildings16224498
Vancouver
Ye Y, Luo Q, Zhao T. Construction Safety Hazard Identification and Corrective Action Generation Based on a Fine-Tuned Vision–Language Model. Buildings. 2026;16(22):4498. doi:10.3390/buildings16224498
BibTeX
@article{Ye2026,
author = {Ye, Yiyi and Luo, Qianmai and Zhao, Tongtong},
title = {Construction Safety Hazard Identification and Corrective Action Generation Based on a Fine-Tuned Vision–Language Model},
journal = {Buildings},
year = {2026},
volume = {16},
number = {22},
pages = {4498},
doi = {10.3390/buildings16224498}
}
EUVIMED