EUVIMEDDescoperă EUVIMED
Open access · CC BY 4.0

MSFRNet: Two‐stream deep forgery detector via multi‐scale feature extraction

Miaomiao Yu, Jun Zhang, Shuohao Li, Jun Lei

IET Image Processing · 2023-02 · 17 (2) · 581-596

DOI: 10.1049/ipr2.12657 ↗

At a glance

Journal article in IET Image Processing, published online on 2022-10-18. Written by Miaomiao Yu and 3 co-authors. Cited 4 times so far (Crossref); 54 references. The full text is freely available (open access, CC BY 4.0).

RezumatDate bibliograficeCiteRelated studies

Abstract (original language)

Face forgery represented by DeepFake technique has raised severe societal concerns. Due to the different scales of tampering traces and the different resolutions of face images, adopting common processing pipelines and standard form of convolutional neural networks (CNNs) will lead to problems such as omission, redundancy, and bias when extracting key discriminative features. To solve the above issues, unlike most existing methods that treat face forensics as a vanilla binary classification task, the authors instead reformulate it as a multi‐scale object detection problem and propose a novel framework called MSFRNet based on multi‐scale feature extraction. Concretely, to alleviate the issues of features omission and redundancy, the authors construct a two‐stream prediction network, where the shallow branch discovers small‐scale objects such as tiny noise by capturing low‐level features with higher resolution and more details, while the deep stream exploits larger receptive fields to detect large‐scale blocky artefacts. Moreover, a multi‐scale feature extraction module is designed to enrich feature representations in each stream. To solve the problem of features bias and ensure that unbiased feature representations are learned, more appropriate data augmentation approaches are proposed by introducing counterfactual causal reasoning. Extensive experiments demonstrate that our framework outperforms most ordinary binary classifiers and achieves positive performance.

Cite

APA

Yu, M., Zhang, J., Li, S., & Lei, J. (2023). MSFRNet: Two‐stream deep forgery detector via multi‐scale feature extraction. IET Image Processing, 17(2), 581-596. https://doi.org/10.1049/ipr2.12657

Vancouver

Yu M, Zhang J, Li S, Lei J. MSFRNet: Two‐stream deep forgery detector via multi‐scale feature extraction. IET Image Processing. 2023;17(2):581-596. doi:10.1049/ipr2.12657

BibTeX
@article{Yu2023,
  author = {Yu, Miaomiao and Zhang, Jun and Li, Shuohao and Lei, Jun},
  title = {MSFRNet: Two‐stream deep forgery detector via multi‐scale feature extraction},
  journal = {IET Image Processing},
  year = {2023},
  volume = {17},
  number = {2},
  pages = {581--596},
  doi = {10.1049/ipr2.12657}
}
Start for free →