Integrating Spatial and Temporal Information for Violent Activity Detection from Video Using Deep Spiking Neural Networks
Sensors · 06.05.2023 · 23 (9) · 4532
DOI: 10.3390/s23094532 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 06.05.2023. Verfasst von Xiang Wang und 2 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200400, China. Hauptthemen laut MEDLINE: Neural Networks, Computer, Optic Flow. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Increasing violence in workplaces such as hospitals seriously challenges public safety. However, it is time- and labor-consuming to visually monitor masses of video data in real time. Therefore, automatic and timely violent activity detection from videos is vital, especially for small monitoring systems. This paper proposes a two-stream deep learning architecture for video violent activity detection named SpikeConvFlowNet. First, RGB frames and their optical flow data are used as inputs for each stream to extract the spatiotemporal features of videos. After that, the spatiotemporal features from the two streams are concatenated and fed to the classifier for the final decision. Each stream utilizes a supervised neural network consisting of multiple convolutional spiking and pooling layers. Convolutional layers are used to extract high-quality spatial features within frames, and spiking neurons can efficiently extract temporal features across frames by remembering historical information. The spiking neuron-based optical flow can strengthen the capability of extracting critical motion information. This method combines their advantages to enhance the performance and efficiency for recognizing violent actions. The experimental results on public datasets demonstrate that, compared with the latest methods, this approach greatly reduces parameters and achieves higher inference efficiency with limited accuracy loss. It is a potential solution for applications in embedded devices that provide low computing power but require fast processing speeds.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of Image Processing and Pattern Recognition, Shanghai Jiao Tong University, Shanghai 200400, China.
- Knowledge Engineering and Discovery Research Institute, Auckland University of Technology, Auckland 1020, New Zealand.
ORCID-Profile: Xiang Wang, Nikola K Kasabov
Zitieren
APA
Wang, X., Yang, J., & Kasabov, N. K. (2023). Integrating Spatial and Temporal Information for Violent Activity Detection from Video Using Deep Spiking Neural Networks. Sensors, 23(9), 4532. https://doi.org/10.3390/s23094532
Vancouver
Wang X, Yang J, Kasabov NK. Integrating Spatial and Temporal Information for Violent Activity Detection from Video Using Deep Spiking Neural Networks. Sensors. 2023;23(9):4532. doi:10.3390/s23094532
BibTeX
@article{Wang2023,
author = {Wang, Xiang and Yang, Jie and Kasabov, Nikola K},
title = {Integrating Spatial and Temporal Information for Violent Activity Detection from Video Using Deep Spiking Neural Networks},
journal = {Sensors},
year = {2023},
volume = {23},
number = {9},
pages = {4532},
doi = {10.3390/s23094532}
}
EUVIMED