EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deepfake Detection Algorithm Based on Dual-Branch Data Augmentation and Modified Attention Mechanism

Da Wan, Manchun Cai, Shufan Peng, Wenkai Qin, Lanting Li

Applied Sciences · 18.07.2023 · 13 (14) · 8313

DOI: 10.3390/app13148313 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 18.07.2023. Verfasst von Da Wan und 4 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Double First-Class Innovation Research Project for People’s Public Security University of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Mainstream deepfake detection algorithms generally fail to fully extract forgery traces and have low accuracy when detecting forged images with natural corruptions or human damage. On this basis, a new algorithm based on an adversarial dual-branch data augmentation framework and a modified attention mechanism is proposed in this paper to improve the robustness of detection models. First, this paper combines the traditional random sampling augmentation method with the adversarial sample idea to enhance and expand the forged images in data preprocessing. Then, we obtain training samples with diversity and hardness uniformity. Meanwhile, a new attention mechanism is modified and added to the ResNet50 model. The improved model serves as the backbone, effectively increasing the weight of forged traces in the multi-scale feature maps. The Jensen–Shannon divergence loss and cosine annealing algorithms are introduced into the training process to improve the model’s accuracy and convergence speed. The proposed algorithm is validated on standard and corrupted datasets. The experiments show that the algorithm proposed in this paper significantly improves effectiveness and robustness, with accuracies of 4.16%, 7.37%, and 3.87% better than the baseline model on DeepFakes, FaceSwap, and FaceShifer, respectively. Most importantly, its detection performance on the corrupted datasets DeepFakes-C, FaceSwap-C, and FaceShifer-C is much higher than that of mainstream methods.

Förderung

  • Double First-Class Innovation Research Project for People’s Public Security University of China

Zitieren

APA

Wan, D., Cai, M., Peng, S., Qin, W., & Li, L. (2023). Deepfake Detection Algorithm Based on Dual-Branch Data Augmentation and Modified Attention Mechanism. Applied Sciences, 13(14), 8313. https://doi.org/10.3390/app13148313

Vancouver

Wan D, Cai M, Peng S, Qin W, Li L. Deepfake Detection Algorithm Based on Dual-Branch Data Augmentation and Modified Attention Mechanism. Applied Sciences. 2023;13(14):8313. doi:10.3390/app13148313

BibTeX
@article{Wan2023,
  author = {Wan, Da and Cai, Manchun and Peng, Shufan and Qin, Wenkai and Li, Lanting},
  title = {Deepfake Detection Algorithm Based on Dual-Branch Data Augmentation and Modified Attention Mechanism},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {14},
  pages = {8313},
  doi = {10.3390/app13148313}
}
Kostenlos starten →