Towards Generalizable Deepfake Video Detection via Saliency-guided and Temporal-Frequency Fusion Network
ACM Transactions on Multimedia Computing, Communications, and Applications · 16.11.2026
DOI: 10.1145/3860637 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 16.11.2026. Verfasst von Weicheng Song und 2 weiteren Autor:innen. Die Arbeit nennt 51 Literaturangaben.
Abstract (Originalsprache)
The proliferation of deepfake technology poses significant threats to information security, social trust, and personal privacy. Existing deepfake detection methods predominantly focus on spatial domain features and often overlook temporal inconsistencies and frequency cues. Thus, their robustness and generalization capabilities are limited, especially in deepfake video detection. To address these limitations, this paper proposes a Saliency-guided and Temporal-Frequency Fusion Network (STFFNet) for deepfake video detection. The proposed method integrates three key components: a Saliency-Guided Feature Perturbation (SGFP) module to bolster robustness, a Temporal Consistency Enhancement Transformer (TCET) optimized with contrastive loss to capture fine-grained inter-frame relations, and a Spatial-Frequency Fusion (SFF) module designed to synergistically fuse spatial and frequency signals for enhanced discriminative power. Comprehensive experiments on benchmark datasets (FF++, Celeb-DF-v1, Celeb-DF-v2, DFDCP, and FaceShifter) demonstrate that STFFNet achieves state-of-the-art performance with an average AUC of 92% in the frame level and 96% in the video level. Ablation studies validate the complementary contributions of each module, establishing STFFNet as a robust and generalizable solution for deepfake detection. The code is available at https://github.com/swc-code-cc/STFFNet .
Zitieren
APA
Song, W., Guo, S., & Gao, M. (2026). Towards Generalizable Deepfake Video Detection via Saliency-guided and Temporal-Frequency Fusion Network. ACM Transactions on Multimedia Computing, Communications, and Applications. https://doi.org/10.1145/3860637
Vancouver
Song W, Guo S, Gao M. Towards Generalizable Deepfake Video Detection via Saliency-guided and Temporal-Frequency Fusion Network. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026. doi:10.1145/3860637
BibTeX
@article{Song2026,
author = {Song, Weicheng and Guo, Siyou and Gao, Mingliang},
title = {Towards Generalizable Deepfake Video Detection via Saliency-guided and Temporal-Frequency Fusion Network},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2026},
doi = {10.1145/3860637}
}
EUVIMED