Leveraging Multi-Modality and Enhanced Temporal Networks for Robust Violence Detection
Machine Learning and Knowledge Extraction · 28.10.2024 · 6 (4) · 2422-2434
DOI: 10.3390/make6040119 ↗Kurz gefasst
Fachartikel in der Zeitschrift Machine Learning and Knowledge Extraction, online erschienen am 28.10.2024. Verfasst von Gwangho Na und 2 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In this paper, we present a novel model that enhances performance by extending the dual-modality TEVAD model—originally leveraging visual and textual information—into a multi-modal framework that integrates visual, audio, and textual data. Additionally, we refine the multi-scale temporal network (MTN) to improve feature extraction across multiple temporal scales between video snippets. Using the XD-Violence dataset, which includes audio data for violence detection, we conduct experiments to evaluate various feature fusion methods. The proposed model achieves an average precision (AP) of 83.9%, surpassing the performance of single-modality approaches (visual: 73.9%, audio: 67.1%, textual: 29.9%) and dual-modality approaches (visual + audio: 78.8%, visual + textual: 78.5%). These findings demonstrate that the proposed model outperforms models based on the original MTN and reaffirm the efficacy of multi-modal approaches in enhancing violence detection compared to single- or dual-modality methods.
Zitieren
APA
Na, G., Ko, J., & Cheoi, K. (2024). Leveraging Multi-Modality and Enhanced Temporal Networks for Robust Violence Detection. Machine Learning and Knowledge Extraction, 6(4), 2422-2434. https://doi.org/10.3390/make6040119
Vancouver
Na G, Ko J, Cheoi K. Leveraging Multi-Modality and Enhanced Temporal Networks for Robust Violence Detection. Machine Learning and Knowledge Extraction. 2024;6(4):2422-2434. doi:10.3390/make6040119
BibTeX
@article{Na2024,
author = {Na, Gwangho and Ko, Jaepil and Cheoi, Kyungjoo},
title = {Leveraging Multi-Modality and Enhanced Temporal Networks for Robust Violence Detection},
journal = {Machine Learning and Knowledge Extraction},
year = {2024},
volume = {6},
number = {4},
pages = {2422--2434},
doi = {10.3390/make6040119}
}
EUVIMED