EUVIMEDEUVIMED entdecken
Crossref

Deep Convolutional Pooling Transformer for Deepfake Detection

Tianyi Wang, Harry Cheng, Kam Pui Chow, Liqiang Nie

ACM Transactions on Multimedia Computing, Communications, and Applications · 30.11.2023 · 19 (6) · 1-20

DOI: 10.1145/3588574 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 30.05.2023. Verfasst von Tianyi Wang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 93-mal zitiert (Crossref) und nennt 69 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recently, Deepfake has drawn considerable public attention due to security and privacy concerns in social media digital forensics. As the wildly spreading Deepfake videos on the Internet become more realistic, traditional detection techniques have failed in distinguishing between real and fake. Most existing deep learning methods mainly focus on local features and relations within the face image using convolutional neural networks as a backbone. However, local features and relations are insufficient for model training to learn enough general information for Deepfake detection. Therefore, the existing Deepfake detection methods have reached a bottleneck to further improve the detection performance. To address this issue, we propose a deep convolutional Transformer to incorporate the decisive image features both locally and globally. Specifically, we apply convolutional pooling and re-attention to enrich the extracted features and enhance efficacy. Moreover, we employ the barely discussed image keyframes in model training for performance improvement and visualize the feature quantity gap between the key and normal image frames caused by video compression. We finally illustrate the transferability with extensive experiments on several Deepfake benchmark datasets. The proposed solution consistently outperforms several state-of-the-art baselines on both within- and cross-dataset experiments.

Zitieren

APA

Wang, T., Cheng, H., Chow, K. P., & Nie, L. (2023). Deep Convolutional Pooling Transformer for Deepfake Detection. ACM Transactions on Multimedia Computing, Communications, and Applications, 19(6), 1-20. https://doi.org/10.1145/3588574

Vancouver

Wang T, Cheng H, Chow KP, Nie L. Deep Convolutional Pooling Transformer for Deepfake Detection. ACM Transactions on Multimedia Computing, Communications, and Applications. 2023;19(6):1-20. doi:10.1145/3588574

BibTeX
@article{Wang2023,
  author = {Wang, Tianyi and Cheng, Harry and Chow, Kam Pui and Nie, Liqiang},
  title = {Deep Convolutional Pooling Transformer for Deepfake Detection},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2023},
  volume = {19},
  number = {6},
  pages = {1--20},
  doi = {10.1145/3588574}
}
Kostenlos starten →