Learning Self-distilled Features for Facial Deepfake Detection Using Visual Foundation Models: General Results and Demographic Analysis
Journal on Interactive Systems · 09.07.2024 · 15 (1) · 682-694
DOI: 10.5753/jis.2024.4120 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal on Interactive Systems, online erschienen am 09.07.2024. Verfasst von Yan Martins Braz Gurevitz Cunha und 6 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Modern deepfake techniques produce highly realistic false media content with the potential for spreading harmful information, including fake news and incitements to violence. Deepfake detection methods aim to identify and counteract such content by employing machine learning algorithms, focusing mainly on detecting the presence of manipulation using spatial and temporal features. These methods often utilize Foundation Models trained on extensive unlabeled data through self-supervised approaches. This work extends previous research on deepfake detection, focusing on the effectiveness of these models while also considering biases, particularly concerning age, gender, and ethnicity, for ethical analysis. Experiments with DINOv2, a novel Vision Transformer-based Foundation Model, trained using the diverse Deepfake Detection Challenge Dataset, which encompasses several lighting conditions, resolutions, and demographic attributes, demonstrated improved deepfake detection when combined with a CNN classifier, with minimal bias towards these demographic characteristics.
Zitieren
APA
Cunha, Y. M. B. G., Gomes, B. R., Boaro, J. M. C., Moraes, D. D. S., Busson, A. J. G., Duarte, J. C., & Colcher, S. (2024). Learning Self-distilled Features for Facial Deepfake Detection Using Visual Foundation Models: General Results and Demographic Analysis. Journal on Interactive Systems, 15(1), 682-694. https://doi.org/10.5753/jis.2024.4120
Vancouver
Cunha YMBG, Gomes BR, Boaro JMC, Moraes DDS, Busson AJG, Duarte JC, et al. Learning Self-distilled Features for Facial Deepfake Detection Using Visual Foundation Models: General Results and Demographic Analysis. Journal on Interactive Systems. 2024;15(1):682-694. doi:10.5753/jis.2024.4120
BibTeX
@article{Cunha2024,
author = {Cunha, Yan Martins Braz Gurevitz and Gomes, Bruno Rocha and Boaro, José Matheus C. and Moraes, Daniel de Sousa and Busson, Antonio José Grandson and Duarte, Julio Cesar and Colcher, Sérgio},
title = {Learning Self-distilled Features for Facial Deepfake Detection Using Visual Foundation Models: General Results and Demographic Analysis},
journal = {Journal on Interactive Systems},
year = {2024},
volume = {15},
number = {1},
pages = {682--694},
doi = {10.5753/jis.2024.4120}
}
EUVIMED