EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

DEEP-STA: Deep Learning-Based Detection and Localization of Various Types of Inter-Frame Video Tampering Using Spatiotemporal Analysis

Naheed Akhtar, Muhammad Hussain, Zulfiqar Habib

Mathematics · 07.06.2024 · 12 (12) · 1778

DOI: 10.3390/math12121778 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 07.06.2024. Verfasst von Naheed Akhtar und 2 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: King Saud University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Inter-frame tampering in surveillance videos undermines the integrity of video evidence, potentially influencing law enforcement investigations and court decisions. This type of tampering is the most common tampering method, often imperceptible to the human eye. Until now, various algorithms have been proposed to identify such tampering, based on handcrafted features. Automatic detection, localization, and determine the tampering type, while maintaining accuracy and processing speed, is still a challenge. We propose a novel method for detecting inter-frame tampering by exploiting a 2D convolution neural network (2D-CNN) of spatiotemporal information and fusion for deep automatic feature extraction, employing an autoencoder to significantly reduce the computational overhead by reducing the dimensionality of the feature’s space; analyzing long-range dependencies within video frames using long short-term memory (LSTM) and gated recurrent units (GRU), which helps to detect tampering traces; and finally, adding a fully connected layer (FC), with softmax activation for classification. The structural similarity index measure (SSIM) is utilized to localize tampering. We perform extensive experiments on datasets, comprised of challenging videos with different complexity levels. The results demonstrate that the proposed method can identify and pinpoint tampering regions with more than 90% accuracy, irrespective of video frame rates, video formats, number of tampering frames, and the compression quality factor.

Förderung

  • King Saud University

Zitieren

APA

Akhtar, N., Hussain, M., & Habib, Z. (2024). DEEP-STA: Deep Learning-Based Detection and Localization of Various Types of Inter-Frame Video Tampering Using Spatiotemporal Analysis. Mathematics, 12(12), 1778. https://doi.org/10.3390/math12121778

Vancouver

Akhtar N, Hussain M, Habib Z. DEEP-STA: Deep Learning-Based Detection and Localization of Various Types of Inter-Frame Video Tampering Using Spatiotemporal Analysis. Mathematics. 2024;12(12):1778. doi:10.3390/math12121778

BibTeX
@article{Akhtar2024,
  author = {Akhtar, Naheed and Hussain, Muhammad and Habib, Zulfiqar},
  title = {DEEP-STA: Deep Learning-Based Detection and Localization of Various Types of Inter-Frame Video Tampering Using Spatiotemporal Analysis},
  journal = {Mathematics},
  year = {2024},
  volume = {12},
  number = {12},
  pages = {1778},
  doi = {10.3390/math12121778}
}
Kostenlos starten →