Detecting Deepfake Videos using Spatiotemporal Trident Network
ACM Transactions on Multimedia Computing, Communications, and Applications · 30.11.2024 · 20 (11) · 1-20
DOI: 10.1145/3623639 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 12.09.2024. Verfasst von Kaihan Lin und 5 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 58 Literaturangaben. Gefördert von: National Key research and Development Plan, National Natural Science Foundation of China, Major Key Project of PCL.
Abstract (Originalsprache)
The widespread dissemination of Deepfake in social networks has posed serious security risks, thus necessitating the development of an effective Deepfake detection technique. Currently, video-based detectors have not been explored as extensively as image-based detectors. Most existing video-based methods only consider temporal features without combining spatial features, and do not mine deeper-level subtle forgeries, resulting in limited detection performance. In this paper, a novel spatiotemporal trident network (STN) is proposed to detect both spatial and temporal inconsistencies of Deepfake videos. Since there is a large amount of redundant information in Deepfake video frames, we introduce convolutional block attention module (CBAM) on the basis of the I3D network and optimize the structure to make the network better focus on the meaningful information of the input video. Aiming at the defects in the deeper-level subtle forgeries, we designed three feature extraction modules (FEMs) of RGB, optical flow, and noise to further extract deeper video frame information. Extensive experiments on several well-known datasets demonstrate that our method has promising performance, surpassing several state-of-the-art Deepfake video detection methods.
Förderung
- National Key research and Development Plan
- National Natural Science Foundation of China
- Major Key Project of PCL
- DongGuan Innovative Research Team Program
- Guangzhou Key research and Development Plan
- Guangdong Higher Education Innovation Group
- Guangzhou Higher Education Innovation Group
- Key Laboratory of the Education Department of Guangdong Province
Zitieren
APA
Lin, K., Han, W., Li, S., Gu, Z., Zhao, H., & Mei, Y. (2024). Detecting Deepfake Videos using Spatiotemporal Trident Network. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(11), 1-20. https://doi.org/10.1145/3623639
Vancouver
Lin K, Han W, Li S, Gu Z, Zhao H, Mei Y. Detecting Deepfake Videos using Spatiotemporal Trident Network. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(11):1-20. doi:10.1145/3623639
BibTeX
@article{Lin2024,
author = {Lin, Kaihan and Han, Weihong and Li, Shudong and Gu, Zhaoquan and Zhao, Huimin and Mei, Yangyang},
title = {Detecting Deepfake Videos using Spatiotemporal Trident Network},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2024},
volume = {20},
number = {11},
pages = {1--20},
doi = {10.1145/3623639}
}
EUVIMED