EUVIMEDEUVIMED entdecken
Crossref

Discriminative Feature Mining Based on Frequency Information and Metric Learning for Face Forgery Detection

Jiaming Li, Hongtao Xie, Lingyun Yu, Xingyu Gao, Yongdong Zhang

IEEE Transactions on Knowledge and Data Engineering · 01.12.2023 · 35 (12) · 12167-12180

DOI: 10.1109/tkde.2021.3117003 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Knowledge and Data Engineering, erschienen am 01.12.2023. Verfasst von Jiaming Li und 4 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 58 Literaturangaben. Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Anhui Postdoctoral Research Activities Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Face forgery detection has received considerable attention due to security concerns about abnormal faces generated by face forgery technology. While recent researches have made prominent progress, they still suffer from two limitations: a) the learned features supervised by softmax loss are insufficiently discriminative, since the softmax loss fails to explicitly boost inter-class separability and intra-class compactness; b) hand-crafted features are unable to effectively mine forgery patterns from frequency domain. To address the two problems, this paper proposes a novel frequency-aware discriminative feature learning framework. Specifically, we design an innovative single-center loss which compresses mere intra-class variations of natural faces while encouraging inter-class differences between natural and manipulated faces in the embedding space. Supervised by such a loss, more discriminative features can be learned with less optimization difficulty. As for frequency-related features, a frequency feature adaptively generated module is developed to capture frequency clues in a data-driven manner. Besides, to better fuse the features of both RGB domain and frequency domain, this paper devises a fusion module based on positional correlation of features. The effectiveness and superiority of our framework have been proved by extensive experiments and our approach achieves state-of-the-art performance in both in-dataset and cross-dataset evaluation.

Förderung

  • National Natural Science Foundation of China
  • China Postdoctoral Science Foundation
  • Anhui Postdoctoral Research Activities Foundation
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Li, J., Xie, H., Yu, L., Gao, X., & Zhang, Y. (2023). Discriminative Feature Mining Based on Frequency Information and Metric Learning for Face Forgery Detection. IEEE Transactions on Knowledge and Data Engineering, 35(12), 12167-12180. https://doi.org/10.1109/tkde.2021.3117003

Vancouver

Li J, Xie H, Yu L, Gao X, Zhang Y. Discriminative Feature Mining Based on Frequency Information and Metric Learning for Face Forgery Detection. IEEE Transactions on Knowledge and Data Engineering. 2023;35(12):12167-12180. doi:10.1109/tkde.2021.3117003

BibTeX
@article{Li2023,
  author = {Li, Jiaming and Xie, Hongtao and Yu, Lingyun and Gao, Xingyu and Zhang, Yongdong},
  title = {Discriminative Feature Mining Based on Frequency Information and Metric Learning for Face Forgery Detection},
  journal = {IEEE Transactions on Knowledge and Data Engineering},
  year = {2023},
  volume = {35},
  number = {12},
  pages = {12167--12180},
  doi = {10.1109/tkde.2021.3117003}
}
Kostenlos starten →