EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Neutralizing Misleading Visual Cues: An Attention-Driven Encoder–Decoder Framework with Auxiliary Forensic Reconstruction for Video Deepfake Detection

Krity Duhan, Abhishek Kajal

AI · 04.11.2026 · 7 (11) · 460

DOI: 10.3390/ai7110460 ↗

Kurz gefasst

Fachartikel in der Zeitschrift AI, online erschienen am 04.11.2026. Verfasst von Krity Duhan und 1 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As deepfake generation methods are constantly evolving, there is a need for new methods that can detect subtle manipulation artefacts in video content, both in terms of spatial and temporal characteristics. In this study, an encoder–decoder architecture is proposed, where the classification and forensic reconstruction are performed simultaneously at the encoder and decoder side, respectively. The architecture consists of a six-layer convolutional encoder to obtain spatial representations from uniformly sampled facial frames of 128 × 128, and a two-layer bidirectional gated recurrent unit (BiGRU) to model temporal dependency within the sequence of eight facial frames. An attention-pooling mechanism additionally highlights the most instructive temporal characteristics and yields a brief sequence-level representation for binary categorization. In parallel, a forensic decoder reconstructs 64 × 64 Laplacian residual maps, encouraging the network to learn edge-level and texture-level manipulation traces. The framework is trained end-to-end using a weighted combination of cross-entropy classification loss and L1 reconstruction loss. Experiments on the Celeb-DF dataset, comprising 1168 cropped face videos, achieved 93% training accuracy, 90% frame-level classification accuracy, and an ROC-AUC of 0.92. Complementary analysis across spatial, frequency, and temporal feature domains showed that spatial texture characteristics provided the clearest class separation, while the forensic reconstruction branch achieved an MSE of 0.010. Overall, the results demonstrate the value of jointly integrating spatial encoding, temporal sequence modelling, attention-based aggregation, and reconstruction-guided forensic learning for deepfake detection.

Zitieren

APA

Duhan, K., & Kajal, A. (2026). Neutralizing Misleading Visual Cues: An Attention-Driven Encoder–Decoder Framework with Auxiliary Forensic Reconstruction for Video Deepfake Detection. AI, 7(11), 460. https://doi.org/10.3390/ai7110460

Vancouver

Duhan K, Kajal A. Neutralizing Misleading Visual Cues: An Attention-Driven Encoder–Decoder Framework with Auxiliary Forensic Reconstruction for Video Deepfake Detection. AI. 2026;7(11):460. doi:10.3390/ai7110460

BibTeX
@article{Duhan2026,
  author = {Duhan, Krity and Kajal, Abhishek},
  title = {Neutralizing Misleading Visual Cues: An Attention-Driven Encoder–Decoder Framework with Auxiliary Forensic Reconstruction for Video Deepfake Detection},
  journal = {AI},
  year = {2026},
  volume = {7},
  number = {11},
  pages = {460},
  doi = {10.3390/ai7110460}
}
Kostenlos starten →