Generalizable Deepfake Detection With Phase-Based Motion Analysis
IEEE Transactions on Image Processing · 2025 · 34 · 100-112
DOI: 10.1109/tip.2024.3441821 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2025. Verfasst von Ekta Prashnani und 2 weiteren Autor:innen. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 85 Literaturangaben. Gefördert von: NSF, Computational Facilities Purchased under NSF, Dissertation Fellowship funded by the Department of Electrical and Computer Engineering at UC Santa Barbara.
Abstract (Originalsprache)
We propose PhaseForensics, a DeepFake (DF) video detection method that uses a phase-based motion representation of facial temporal dynamics. Existing methods that rely on temporal information across video frames for DF detection have many advantages over the methods that only utilize the per-frame features. However, these temporal DF detection methods still show limited cross-dataset generalization and robustness to common distortions due to factors such as error-prone motion estimation, inaccurate landmark tracking, or the susceptibility of the pixel intensity-based features to adversarial distortions and the cross-dataset domain shifts. Our key insight to overcome these issues is to leverage the temporal phase variations in the band-pass frequency components of a face region across video frames. This not only enables a robust estimate of the temporal dynamics in the facial regions, but is also less prone to cross-dataset variations. Furthermore, we show that the band-pass filters used to compute the local per-frame phase form an effective defense against the perturbations commonly seen in gradient-based adversarial attacks. Overall, with PhaseForensics, we show improved distortion and adversarial robustness, and state-of-the-art cross-dataset generalization, with 92.4% video-level AUC on the challenging CelebDFv2 benchmark (a recent state of-the-art method, FTCN, compares at 86.9%).
Förderung
- NSF
- Computational Facilities Purchased under NSF
- Dissertation Fellowship funded by the Department of Electrical and Computer Engineering at UC Santa Barbara
Zitieren
APA
Prashnani, E., Goebel, M., & Manjunath, B. S. (2025). Generalizable Deepfake Detection With Phase-Based Motion Analysis. IEEE Transactions on Image Processing, 34, 100-112. https://doi.org/10.1109/tip.2024.3441821
Vancouver
Prashnani E, Goebel M, Manjunath BS. Generalizable Deepfake Detection With Phase-Based Motion Analysis. IEEE Transactions on Image Processing. 2025;34:100-112. doi:10.1109/tip.2024.3441821
BibTeX
@article{Prashnani2025,
author = {Prashnani, Ekta and Goebel, Michael and Manjunath, B S},
title = {Generalizable Deepfake Detection With Phase-Based Motion Analysis},
journal = {IEEE Transactions on Image Processing},
year = {2025},
volume = {34},
pages = {100--112},
doi = {10.1109/tip.2024.3441821}
}
EUVIMED