LDFnet: Lightweight Dynamic Fusion Network for Face Forgery Detection by Integrating Local Artifacts and Global Texture Information
IEEE Transactions on Circuits and Systems for Video Technology · 2024-02 · 34 (2) · 1255-1265
DOI: 10.1109/tcsvt.2023.3289147 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-02. Verfasst von Zhiqing Guo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 59-mal zitiert (Crossref) und nennt 50 Literaturangaben. Gefördert von: Scientific and Technological Innovation 2030 Major Project, National Natural Science Foundation of China, Autonomous Region Key Research and Development Task Special.
Abstract (Originalsprache)
Face forgery detection has become a new research hotspot. Though existing detection works have achieved impressive performance, they are difficult to achieve a proper trade-off between detection accuracy and model complexity. To solve this problem, we design some low-complexity modules and construct a lightweight dynamic fusion network (LDFnet) to achieve high accuracy and lightweight face forgery detection. Firstly, we regard significant local visual artifacts as a correct semantic feature needed for detection. A spatial group-wise enhance (SGE) module is introduced as a supervision to suppress possible noise and capture local artifacts. Secondly, we design a manipulation trace extraction block (TraceBlock), which can replace vanilla convolution to achieve global inference, thus capturing the texture information in the global scope. Based on TraceBlock, we construct a global texture representation (GTR) network to extract global manipulation features hierarchically. Finally, we design a dynamic fusion mechanism (DFM) to fully fuse local and global clues, and dynamically generate a more discriminating feature representation. Extensive experimental results show that the proposed LDFnet is significantly superior to the previous detection works on some popular face forgery datasets, such as FF++, DFDC, CelebDF and HFF. In particular, LDFnet only uses 963k model parameters and 801M FLOPs, which is far lower than the calculation cost of face forgery detection based on large model, and achieves better detection results.
Förderung
- Scientific and Technological Innovation 2030 Major Project
- National Natural Science Foundation of China
- Autonomous Region Key Research and Development Task Special
- Scientific and Technological Innovation Leading Talent Project
Zitieren
APA
Guo, Z., Wang, L., Yang, W., Yang, G., & Li, K. (2024). LDFnet: Lightweight Dynamic Fusion Network for Face Forgery Detection by Integrating Local Artifacts and Global Texture Information. IEEE Transactions on Circuits and Systems for Video Technology, 34(2), 1255-1265. https://doi.org/10.1109/tcsvt.2023.3289147
Vancouver
Guo Z, Wang L, Yang W, Yang G, Li K. LDFnet: Lightweight Dynamic Fusion Network for Face Forgery Detection by Integrating Local Artifacts and Global Texture Information. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(2):1255-1265. doi:10.1109/tcsvt.2023.3289147
BibTeX
@article{Guo2024,
author = {Guo, Zhiqing and Wang, Liejun and Yang, Wenzhong and Yang, Gaobo and Li, Keqin},
title = {LDFnet: Lightweight Dynamic Fusion Network for Face Forgery Detection by Integrating Local Artifacts and Global Texture Information},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {2},
pages = {1255--1265},
doi = {10.1109/tcsvt.2023.3289147}
}
EUVIMED