EUVIMEDAtrasti EUVIMED
Open access · CC BY 4.0

Leveraging Multi-Modality and Enhanced Temporal Networks for Robust Violence Detection

Gwangho Na, Jaepil Ko, Kyungjoo Cheoi

Machine Learning and Knowledge Extraction · 2024-10-28 · 6 (4) · 2422-2434

DOI: 10.3390/make6040119 ↗

At a glance

Journal article in Machine Learning and Knowledge Extraction, published online on 2024-10-28. Written by Gwangho Na and 2 co-authors. Cited 8 times so far (Crossref); 29 references. The full text is freely available (open access, CC BY 4.0).

SantraukaBibliografiniai duomenysCiteRelated studies

Abstract (original language)

In this paper, we present a novel model that enhances performance by extending the dual-modality TEVAD model—originally leveraging visual and textual information—into a multi-modal framework that integrates visual, audio, and textual data. Additionally, we refine the multi-scale temporal network (MTN) to improve feature extraction across multiple temporal scales between video snippets. Using the XD-Violence dataset, which includes audio data for violence detection, we conduct experiments to evaluate various feature fusion methods. The proposed model achieves an average precision (AP) of 83.9%, surpassing the performance of single-modality approaches (visual: 73.9%, audio: 67.1%, textual: 29.9%) and dual-modality approaches (visual + audio: 78.8%, visual + textual: 78.5%). These findings demonstrate that the proposed model outperforms models based on the original MTN and reaffirm the efficacy of multi-modal approaches in enhancing violence detection compared to single- or dual-modality methods.

Cite

APA

Na, G., Ko, J., & Cheoi, K. (2024). Leveraging Multi-Modality and Enhanced Temporal Networks for Robust Violence Detection. Machine Learning and Knowledge Extraction, 6(4), 2422-2434. https://doi.org/10.3390/make6040119

Vancouver

Na G, Ko J, Cheoi K. Leveraging Multi-Modality and Enhanced Temporal Networks for Robust Violence Detection. Machine Learning and Knowledge Extraction. 2024;6(4):2422-2434. doi:10.3390/make6040119

BibTeX
@article{Na2024,
  author = {Na, Gwangho and Ko, Jaepil and Cheoi, Kyungjoo},
  title = {Leveraging Multi-Modality and Enhanced Temporal Networks for Robust Violence Detection},
  journal = {Machine Learning and Knowledge Extraction},
  year = {2024},
  volume = {6},
  number = {4},
  pages = {2422--2434},
  doi = {10.3390/make6040119}
}
Start for free →