EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Gated Fusion Networks for Multi-Modal Violence Detection

Bilal Ahmad, Mustaqeem Khan, Muhammad Sajjad

AI · 03.10.2025 · 6 (10) · 259

DOI: 10.3390/ai6100259 ↗

Kurz gefasst

Fachartikel in der Zeitschrift AI, online erschienen am 03.10.2025. Verfasst von Bilal Ahmad und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Public safety and security require an effective monitoring system to detect violence through visual, audio, and motion data. However, current methods often fail to utilize the complementary benefits of visual and auditory modalities, thereby reducing their overall effectiveness. To enhance violence detection, we present a novel multimodal method in this paper that detects motion, audio, and visual information from the input to recognize violence. We designed a framework comprising two specialized components: a gated fusion module and a multi-scale transformer, which enables the efficient detection of violence in multimodal data. To ensure a seamless and effective integration of features, a gated fusion module dynamically adjusts the contribution of each modality. At the same time, a multi-modal transformer utilizes multiple instance learning (MIL) to identify violent behaviors more accurately from input data by capturing complex temporal correlations. Our model fully integrates multi-modal information using these techniques, improving the accuracy of violence detection. In this study, we found that our approach outperformed state-of-the-art methods with an accuracy of 86.85% using the XD-Violence dataset, thereby demonstrating the potential of multi-modal fusion in detecting violence.

Zitieren

APA

Ahmad, B., Khan, M., & Sajjad, M. (2025). Gated Fusion Networks for Multi-Modal Violence Detection. AI, 6(10), 259. https://doi.org/10.3390/ai6100259

Vancouver

Ahmad B, Khan M, Sajjad M. Gated Fusion Networks for Multi-Modal Violence Detection. AI. 2025;6(10):259. doi:10.3390/ai6100259

BibTeX
@article{Ahmad2025,
  author = {Ahmad, Bilal and Khan, Mustaqeem and Sajjad, Muhammad},
  title = {Gated Fusion Networks for Multi-Modal Violence Detection},
  journal = {AI},
  year = {2025},
  volume = {6},
  number = {10},
  pages = {259},
  doi = {10.3390/ai6100259}
}
Kostenlos starten →