EUVIMEDEUVIMED entdecken
Crossref

Detecting Deepfake Videos using Spatiotemporal Trident Network

Kaihan Lin, Weihong Han, Shudong Li, Zhaoquan Gu, Huimin Zhao, Yangyang Mei

ACM Transactions on Multimedia Computing, Communications, and Applications · 30.11.2024 · 20 (11) · 1-20

DOI: 10.1145/3623639 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 12.09.2024. Verfasst von Kaihan Lin und 5 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 58 Literaturangaben. Gefördert von: National Key research and Development Plan, National Natural Science Foundation of China, Major Key Project of PCL.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The widespread dissemination of Deepfake in social networks has posed serious security risks, thus necessitating the development of an effective Deepfake detection technique. Currently, video-based detectors have not been explored as extensively as image-based detectors. Most existing video-based methods only consider temporal features without combining spatial features, and do not mine deeper-level subtle forgeries, resulting in limited detection performance. In this paper, a novel spatiotemporal trident network (STN) is proposed to detect both spatial and temporal inconsistencies of Deepfake videos. Since there is a large amount of redundant information in Deepfake video frames, we introduce convolutional block attention module (CBAM) on the basis of the I3D network and optimize the structure to make the network better focus on the meaningful information of the input video. Aiming at the defects in the deeper-level subtle forgeries, we designed three feature extraction modules (FEMs) of RGB, optical flow, and noise to further extract deeper video frame information. Extensive experiments on several well-known datasets demonstrate that our method has promising performance, surpassing several state-of-the-art Deepfake video detection methods.

Förderung

  • National Key research and Development Plan
  • National Natural Science Foundation of China
  • Major Key Project of PCL
  • DongGuan Innovative Research Team Program
  • Guangzhou Key research and Development Plan
  • Guangdong Higher Education Innovation Group
  • Guangzhou Higher Education Innovation Group
  • Key Laboratory of the Education Department of Guangdong Province

Zitieren

APA

Lin, K., Han, W., Li, S., Gu, Z., Zhao, H., & Mei, Y. (2024). Detecting Deepfake Videos using Spatiotemporal Trident Network. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(11), 1-20. https://doi.org/10.1145/3623639

Vancouver

Lin K, Han W, Li S, Gu Z, Zhao H, Mei Y. Detecting Deepfake Videos using Spatiotemporal Trident Network. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(11):1-20. doi:10.1145/3623639

BibTeX
@article{Lin2024,
  author = {Lin, Kaihan and Han, Weihong and Li, Shudong and Gu, Zhaoquan and Zhao, Huimin and Mei, Yangyang},
  title = {Detecting Deepfake Videos using Spatiotemporal Trident Network},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2024},
  volume = {20},
  number = {11},
  pages = {1--20},
  doi = {10.1145/3623639}
}
Kostenlos starten →