EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Unsafe-Net: YOLO v4 and ConvLSTM based computer vision system for real-time detection of unsafe behaviours in workplace

Oğuzhan Önal, Emre Dandıl

Multimedia Tools and Applications · 04.05.2024 · 84 (29) · 34967-34993

DOI: 10.1007/s11042-024-19276-8 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Multimedia Tools and Applications, online erschienen am 04.05.2024. Verfasst von Oğuzhan Önal und 1 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Bilecik Şeyh Edebali Üniversitesi, Bilecik Seyh Edebali University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Unsafe behaviour is a leading cause of death or injury in the workplace, including many accidents. Despite regular safety inspections in workplaces, many accidents occur as a result of breaches of occupational health and safety protocols. In these environments, despite efforts to prevent accidents and losses in hazardous environments, human error cannot be completely eliminated. In particular, in computer-based solutions, automated behaviour detection has low accuracy, is very costly, not real-time and requires a lot of time. In this study, we propose Unsafe-Net, a hybrid computer vision approach using deep learning models for real-time classification of unsafe behaviours in workplace. For the Unsafe-Net, a dataset is first specifically created by capturing 39 days of video footage from a factory. Using this dataset, YOLO v4 and ConvLSTM methods are combined for object detection and video understanding to achieve fast and accurate results. In the experimental studies, the classification accuracy of unsafe behaviours using the proposed Unsafe-Net method is 95.81% and the average time for action recognition from videos is 0.14 s. In addition, the Unsafe-Net has increased the real-time detection speed by reducing the average video duration to 1.87 s. In addition, the system is installed in a real-time working environment in the factory and employees are immediately alerted by the system, both audibly and visually, when unsafe behaviour occurs. As a result of the installation of the system in the factory environment, it has been determined that the recurrence rate of unsafe behaviour has been reduced by approximately 75%.

Förderung

  • Bilecik Şeyh Edebali Üniversitesi
  • Bilecik Seyh Edebali University

Zitieren

APA

Önal, O., & Dandıl, E. (2024). Unsafe-Net: YOLO v4 and ConvLSTM based computer vision system for real-time detection of unsafe behaviours in workplace. Multimedia Tools and Applications, 84(29), 34967-34993. https://doi.org/10.1007/s11042-024-19276-8

Vancouver

Önal O, Dandıl E. Unsafe-Net: YOLO v4 and ConvLSTM based computer vision system for real-time detection of unsafe behaviours in workplace. Multimedia Tools and Applications. 2024;84(29):34967-34993. doi:10.1007/s11042-024-19276-8

BibTeX
@article{nal2024,
  author = {Önal, Oğuzhan and Dandıl, Emre},
  title = {Unsafe-Net: YOLO v4 and ConvLSTM based computer vision system for real-time detection of unsafe behaviours in workplace},
  journal = {Multimedia Tools and Applications},
  year = {2024},
  volume = {84},
  number = {29},
  pages = {34967--34993},
  doi = {10.1007/s11042-024-19276-8}
}
Kostenlos starten →