EUVIMEDEUVIMED entdecken
Crossref

WebP-JPEG Transcoding Detection by Spotting Re-Compression Artifacts With CNN-ViT for Processing Dual-Domain Features

Bin Li, Jian Shi, Weixiang Li, Haodong Li

IEEE Transactions on Circuits and Systems for Video Technology · 2024-12 · 34 (12) · 12535-12549

DOI: 10.1109/tcsvt.2024.3431669 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-12. Verfasst von Bin Li und 3 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The trace of double compression can serve as a crucial evidence of image manipulation for forensic investigation. With the ever-increasing popularity of WebP format, a new type of double compression case, WebP-JPEG transcoding, has emerged. However, distinguishing it from two common compression cases, single JPEG (SJPEG) and double JPEG (DJPEG) has not yet been studied. In this paper, we propose a specialized method for the new task. Firstly, a detailed analysis is conducted to reveal the differences in compression artifacts between WebP-JPEG and SJPEG/DJPEG, which manifests in the distributions of $4\times 4$ / $8\times 8$ DCT coefficients and the high-frequency portions of image spectrum. Then, multi-modality DCT histograms (MMDH) and high-pass-filtered image residuals (HPFIR) are proposed as front-end dual-domain forensic features to expose the above differences. An indispensable part of these features are extracted through a novel frequency-isolation module (FIM), offering additional information based on the derived relationship between $4\times 4$ and $8\times 8$ DCT coefficients. Finally, a CNN-ViT (Convolutional Neural Network-Vision Transformer) dual-stream network is designed to learn back-end deep features for a reliable detection, where a CNN stream is used to process statistical features in MMDH while a ViT stream to learn spatial correlations in HPFIR. Extensive experimental results demonstrate that the proposed method significantly outperforms state-of-the-art double compression detection methods in distinguishing WebP-JPEG from SJPEG/DJPEG and is more effective in tampering localization. In specific, the proposed method achieves an average detection accuracy of 0.942 for small images of size $128\times 128$ .

Förderung

  • National Natural Science Foundation of China
  • China Postdoctoral Science Foundation

Zitieren

APA

Li, B., Shi, J., Li, W., & Li, H. (2024). WebP-JPEG Transcoding Detection by Spotting Re-Compression Artifacts With CNN-ViT for Processing Dual-Domain Features. IEEE Transactions on Circuits and Systems for Video Technology, 34(12), 12535-12549. https://doi.org/10.1109/tcsvt.2024.3431669

Vancouver

Li B, Shi J, Li W, Li H. WebP-JPEG Transcoding Detection by Spotting Re-Compression Artifacts With CNN-ViT for Processing Dual-Domain Features. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(12):12535-12549. doi:10.1109/tcsvt.2024.3431669

BibTeX
@article{Li2024,
  author = {Li, Bin and Shi, Jian and Li, Weixiang and Li, Haodong},
  title = {WebP-JPEG Transcoding Detection by Spotting Re-Compression Artifacts With CNN-ViT for Processing Dual-Domain Features},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {12},
  pages = {12535--12549},
  doi = {10.1109/tcsvt.2024.3431669}
}
Kostenlos starten →