EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deepfake Face Detection and Adversarial Attack Defense Method Based on Multi-Feature Decision Fusion

Shanzhong Lei, Junfang Song, Feiyang Feng, Zhuyang Yan, Aixin Wang

Applied Sciences · 11.06.2025 · 15 (12) · 6588

DOI: 10.3390/app15126588 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 11.06.2025. Verfasst von Shanzhong Lei und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Scientific Research Program, Innovation Practice Project, Xizang Minzu University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid advancement in deep forgery technology in recent years has created highly deceptive face video content, posing significant security risks. Detecting these fakes is increasingly urgent and challenging. To improve the accuracy of deepfake face detection models and strengthen their resistance to adversarial attacks, this manuscript introduces a method for detecting forged faces and defending against adversarial attacks based on a multi-feature decision fusion. This approach allows for rapid detection of fake faces while effectively countering adversarial attacks. Firstly, an improved IMTCCN network was employed to precisely extract facial features, complemented by a diffusion model for noise reduction and artifact removal. Subsequently, the FG-TEFusionNet (Facial-geometry and Texture enhancement fusion-Net) model was developed for deepfake face detection and assessment. This model comprises two key modules: one for extracting temporal features between video frames and another for spatial features within frames. Initially, a facial geometry landmark calibration module based on the LRNet baseline framework ensured an accurate representation of facial geometry. A SENet attention mechanism was then integrated into the dual-stream RNN to enhance the model’s capability to extract inter-frame information and derive preliminary assessment results based on inter-frame relationships. Additionally, a Gram image texture feature module was designed and integrated into EfficientNet and the attention maps of WSDAN (Weakly Supervised Data Augmentation Network). This module aims to extract deep-level feature information from the texture structure of image frames, addressing the limitations of purely geometric features. The final decisions from both modules were integrated using a voting method, completing the deepfake face detection process. Ultimately, the model’s robustness was validated by generating adversarial samples using the I-FGSM algorithm and optimizing model performance through adversarial training. Extensive experiments demonstrated the superior performance and effectiveness of the proposed method across four subsets of FaceForensics++ and the Celeb-DF dataset.

Förderung

  • Scientific Research Program
  • Innovation Practice Project
  • Xizang Minzu University
  • National Natural Science Foundation of China
  • Special Scientific Research Program Project of the Shaanxi Provincial Department of Education

Zitieren

APA

Lei, S., Song, J., Feng, F., Yan, Z., & Wang, A. (2025). Deepfake Face Detection and Adversarial Attack Defense Method Based on Multi-Feature Decision Fusion. Applied Sciences, 15(12), 6588. https://doi.org/10.3390/app15126588

Vancouver

Lei S, Song J, Feng F, Yan Z, Wang A. Deepfake Face Detection and Adversarial Attack Defense Method Based on Multi-Feature Decision Fusion. Applied Sciences. 2025;15(12):6588. doi:10.3390/app15126588

BibTeX
@article{Lei2025,
  author = {Lei, Shanzhong and Song, Junfang and Feng, Feiyang and Yan, Zhuyang and Wang, Aixin},
  title = {Deepfake Face Detection and Adversarial Attack Defense Method Based on Multi-Feature Decision Fusion},
  journal = {Applied Sciences},
  year = {2025},
  volume = {15},
  number = {12},
  pages = {6588},
  doi = {10.3390/app15126588}
}
Kostenlos starten →