DEEP-STA: Deep Learning-Based Detection and Localization of Various Types of Inter-Frame Video Tampering Using Spatiotemporal Analysis
Mathematics · 07.06.2024 · 12 (12) · 1778
DOI: 10.3390/math12121778 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 07.06.2024. Verfasst von Naheed Akhtar und 2 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: King Saud University.
Abstract (Originalsprache)
Inter-frame tampering in surveillance videos undermines the integrity of video evidence, potentially influencing law enforcement investigations and court decisions. This type of tampering is the most common tampering method, often imperceptible to the human eye. Until now, various algorithms have been proposed to identify such tampering, based on handcrafted features. Automatic detection, localization, and determine the tampering type, while maintaining accuracy and processing speed, is still a challenge. We propose a novel method for detecting inter-frame tampering by exploiting a 2D convolution neural network (2D-CNN) of spatiotemporal information and fusion for deep automatic feature extraction, employing an autoencoder to significantly reduce the computational overhead by reducing the dimensionality of the feature’s space; analyzing long-range dependencies within video frames using long short-term memory (LSTM) and gated recurrent units (GRU), which helps to detect tampering traces; and finally, adding a fully connected layer (FC), with softmax activation for classification. The structural similarity index measure (SSIM) is utilized to localize tampering. We perform extensive experiments on datasets, comprised of challenging videos with different complexity levels. The results demonstrate that the proposed method can identify and pinpoint tampering regions with more than 90% accuracy, irrespective of video frame rates, video formats, number of tampering frames, and the compression quality factor.
Förderung
- King Saud University
Zitieren
APA
Akhtar, N., Hussain, M., & Habib, Z. (2024). DEEP-STA: Deep Learning-Based Detection and Localization of Various Types of Inter-Frame Video Tampering Using Spatiotemporal Analysis. Mathematics, 12(12), 1778. https://doi.org/10.3390/math12121778
Vancouver
Akhtar N, Hussain M, Habib Z. DEEP-STA: Deep Learning-Based Detection and Localization of Various Types of Inter-Frame Video Tampering Using Spatiotemporal Analysis. Mathematics. 2024;12(12):1778. doi:10.3390/math12121778
BibTeX
@article{Akhtar2024,
author = {Akhtar, Naheed and Hussain, Muhammad and Habib, Zulfiqar},
title = {DEEP-STA: Deep Learning-Based Detection and Localization of Various Types of Inter-Frame Video Tampering Using Spatiotemporal Analysis},
journal = {Mathematics},
year = {2024},
volume = {12},
number = {12},
pages = {1778},
doi = {10.3390/math12121778}
}
EUVIMED