EUVIMEDEUVIMED entdecken
Crossref

LDFnet: Lightweight Dynamic Fusion Network for Face Forgery Detection by Integrating Local Artifacts and Global Texture Information

Zhiqing Guo, Liejun Wang, Wenzhong Yang, Gaobo Yang, Keqin Li

IEEE Transactions on Circuits and Systems for Video Technology · 2024-02 · 34 (2) · 1255-1265

DOI: 10.1109/tcsvt.2023.3289147 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-02. Verfasst von Zhiqing Guo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 59-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: Scientific and Technological Innovation 2030 Major Project, National Natural Science Foundation of China, Autonomous Region Key Research and Development Task Special.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Face forgery detection has become a new research hotspot. Though existing detection works have achieved impressive performance, they are difficult to achieve a proper trade-off between detection accuracy and model complexity. To solve this problem, we design some low-complexity modules and construct a lightweight dynamic fusion network (LDFnet) to achieve high accuracy and lightweight face forgery detection. Firstly, we regard significant local visual artifacts as a correct semantic feature needed for detection. A spatial group-wise enhance (SGE) module is introduced as a supervision to suppress possible noise and capture local artifacts. Secondly, we design a manipulation trace extraction block (TraceBlock), which can replace vanilla convolution to achieve global inference, thus capturing the texture information in the global scope. Based on TraceBlock, we construct a global texture representation (GTR) network to extract global manipulation features hierarchically. Finally, we design a dynamic fusion mechanism (DFM) to fully fuse local and global clues, and dynamically generate a more discriminating feature representation. Extensive experimental results show that the proposed LDFnet is significantly superior to the previous detection works on some popular face forgery datasets, such as FF++, DFDC, CelebDF and HFF. In particular, LDFnet only uses 963k model parameters and 801M FLOPs, which is far lower than the calculation cost of face forgery detection based on large model, and achieves better detection results.

Förderung

  • Scientific and Technological Innovation 2030 Major Project
  • National Natural Science Foundation of China
  • Autonomous Region Key Research and Development Task Special
  • Scientific and Technological Innovation Leading Talent Project

Zitieren

APA

Guo, Z., Wang, L., Yang, W., Yang, G., & Li, K. (2024). LDFnet: Lightweight Dynamic Fusion Network for Face Forgery Detection by Integrating Local Artifacts and Global Texture Information. IEEE Transactions on Circuits and Systems for Video Technology, 34(2), 1255-1265. https://doi.org/10.1109/tcsvt.2023.3289147

Vancouver

Guo Z, Wang L, Yang W, Yang G, Li K. LDFnet: Lightweight Dynamic Fusion Network for Face Forgery Detection by Integrating Local Artifacts and Global Texture Information. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(2):1255-1265. doi:10.1109/tcsvt.2023.3289147

BibTeX
@article{Guo2024,
  author = {Guo, Zhiqing and Wang, Liejun and Yang, Wenzhong and Yang, Gaobo and Li, Keqin},
  title = {LDFnet: Lightweight Dynamic Fusion Network for Face Forgery Detection by Integrating Local Artifacts and Global Texture Information},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {2},
  pages = {1255--1265},
  doi = {10.1109/tcsvt.2023.3289147}
}
Kostenlos starten →