EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-feature fusion based face forgery detection with local and global characteristics

Yuanqing Ding, Fanliang Bu iD, Hanming Zhai, Zhiwen Hou, Yifan Wang

PLOS ONE · 2024

DOI: 10.1371/journal.pone.0311720 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Yuanqing Ding und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Network Security, People's Public Security University of China, Beijing, China. Hauptthemen laut MEDLINE: Video Recording. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Public Security of the People's Republic of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The malicious use of deepfake videos seriously affects information security and brings great harm to society. Currently, deepfake videos are mainly generated based on deep learning methods, which are difficult to be recognized by the naked eye, therefore, it is of great significance to study accurate and efficient deepfake video detection techniques. Most of the existing detection methods focus on analyzing the discriminative information in a specific feature domain for classification from a local or global perspective. Such detection methods based on a single type feature have certain limitations in practical applications. In this paper, we propose a deepfake detection method with the ability to comprehensively analyze the forgery face features, which integrates features in the space domain, noise domain, and frequency domain, and uses the Inception Transformer to learn the mix of global and local information dynamically. We evaluate the proposed method on the DFDC, Celeb-DF, and FaceForensic++ benchmark datasets. Extensive experiments verify the effectiveness and good generalization of the proposed method. Compared with the optimal model, the proposed method with a small number of parameters does not use pre-training, distillation, or assembly, but still achieves competitive performance. The ablation experiments evaluate the role of each component.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Video RecordingHumansFaceDeep LearningAlgorithmsImage Processing, Computer-AssistedComputer Security

Autor:innen und Institutionen

  • School of Information Network Security, People's Public Security University of China, Beijing, China.
  • Department of Criminal Investigation, Sichuan Police College, Luzhou, China.

ORCID-Profile: Fanliang Bu

Förderung

  • Ministry of Public Security of the People's Republic of China

Zitieren

APA

Ding, Y., Bu, F., Zhai, H., Hou, Z., & Wang, Y. (2024). Multi-feature fusion based face forgery detection with local and global characteristics. PLOS ONE. https://doi.org/10.1371/journal.pone.0311720

Vancouver

Ding Y, Bu F, Zhai H, Hou Z, Wang Y. Multi-feature fusion based face forgery detection with local and global characteristics. PLOS ONE. 2024. doi:10.1371/journal.pone.0311720

BibTeX
@article{Ding2024,
  author = {Ding, Yuanqing and Bu, Fanliang and Zhai, Hanming and Hou, Zhiwen and Wang, Yifan},
  title = {Multi-feature fusion based face forgery detection with local and global characteristics},
  journal = {PLOS ONE},
  year = {2024},
  doi = {10.1371/journal.pone.0311720}
}
Kostenlos starten →