Mastering Deepfake Detection: A Cutting-edge Approach to Distinguish GAN and Diffusion-model Images
ACM Transactions on Multimedia Computing, Communications, and Applications · 30.11.2024 · 20 (11) · 1-24
DOI: 10.1145/3652027 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 12.09.2024. Verfasst von Luca Guarnera und 2 weiteren Autor:innen. Die Arbeit wurde bisher 79-mal zitiert (Crossref) und nennt 48 Literaturangaben.
Abstract (Originalsprache)
Detecting and recognizing deepfakes is a pressing issue in the digital age. In this study, we first collected a dataset of pristine images and fake ones properly generated by nine different Generative Adversarial Network (GAN) architectures and four Diffusion Models (DM). The dataset contained a total of 83,000 images, with equal distribution between the real and deepfake data. Then, to address different deepfake detection and recognition tasks, we proposed a hierarchical multi-level approach. At the first level, we classified real images from AI-generated ones. At the second level, we distinguished between images generated by GANs and DMs. At the third level (composed of two additional sub-levels), we recognized the specific GAN and DM architectures used to generate the synthetic data. Experimental results demonstrated that our approach achieved more than 97% classification accuracy, outperforming existing state-of-the-art methods. The models obtained in the different levels turn out to be robust to various attacks such as JPEG compression (with different quality factor values) and resize (and others), demonstrating that the framework can be used and applied in real-world contexts (such as the analysis of multimedia data shared in the various social platforms) for support even in forensic investigations to counter the illicit use of these powerful and modern generative models. We are able to identify the specific GAN and DM architecture used to generate the image, which is critical in tracking down the source of the deepfake. Our hierarchical multi-level approach to deepfake detection and recognition shows promising results in identifying deepfakes allowing focus on underlying task by improving (about 2% on the average) standard multiclass flat detection systems. The proposed method has the potential to enhance the performance of deepfake detection systems, aid in the fight against the spread of fake images, and safeguard the authenticity of digital media.
Zitieren
APA
Guarnera, L., Giudice, O., & Battiato, S. (2024). Mastering Deepfake Detection: A Cutting-edge Approach to Distinguish GAN and Diffusion-model Images. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(11), 1-24. https://doi.org/10.1145/3652027
Vancouver
Guarnera L, Giudice O, Battiato S. Mastering Deepfake Detection: A Cutting-edge Approach to Distinguish GAN and Diffusion-model Images. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(11):1-24. doi:10.1145/3652027
BibTeX
@article{Guarnera2024,
author = {Guarnera, Luca and Giudice, Oliver and Battiato, Sebastiano},
title = {Mastering Deepfake Detection: A Cutting-edge Approach to Distinguish GAN and Diffusion-model Images},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2024},
volume = {20},
number = {11},
pages = {1--24},
doi = {10.1145/3652027}
}
EUVIMED