Just Dance: detection of human body reenactment fake videos
EURASIP Journal on Image and Video Processing · 14.08.2024 · 2024 (1)
DOI: 10.1186/s13640-024-00635-2 ↗Kurz gefasst
Fachartikel in der Zeitschrift EURASIP Journal on Image and Video Processing, online erschienen am 14.08.2024. Verfasst von Omran Alamayreh und 5 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Defense Sciences Office, DARPA, Air Force Research Laboratory, Ministero dell’Istruzione, dell’Università e della Ricerca.
Abstract (Originalsprache)
In the last few years, research on the detection of AI-generated videos has focused exclusively on detecting facial manipulations known as deepfakes. Much less attention has been paid to the detection of artificial non-facial fake videos. In this paper, we address a new forensic task, namely, the detection of fake videos of human body reenactment. To this purpose, we consider videos generated by the “Everybody Dance Now” framework. To accomplish our task, we have constructed and released a novel dataset of fake videos of this kind, referred to as FakeDance dataset. Additionally, we propose two forgery detectors to study the detectability of FakeDance kind of videos. The first one exploits spatial–temporal clues of a given video by means of hand-crafted descriptors, whereas the second detector is an end-to-end detector based on Convolutional Neural Networks (CNNs) trained on purpose. Both detectors have their peculiarities and strengths, working well in different operative scenarios. We believe that our proposed dataset together with the two detectors will contribute to the research on the detection of non-facial fake videos generated by means of AI.
Förderung
- Defense Sciences Office, DARPA
- Air Force Research Laboratory
- Ministero dell’Istruzione, dell’Università e della Ricerca
Zitieren
APA
Alamayreh, O., Fascella, C., Mandelli, S., Tondi, B., Bestagini, P., & Barni, M. (2024). Just Dance: detection of human body reenactment fake videos. EURASIP Journal on Image and Video Processing, 2024(1). https://doi.org/10.1186/s13640-024-00635-2
Vancouver
Alamayreh O, Fascella C, Mandelli S, Tondi B, Bestagini P, Barni M. Just Dance: detection of human body reenactment fake videos. EURASIP Journal on Image and Video Processing. 2024;2024(1). doi:10.1186/s13640-024-00635-2
BibTeX
@article{Alamayreh2024,
author = {Alamayreh, Omran and Fascella, Carmelo and Mandelli, Sara and Tondi, Benedetta and Bestagini, Paolo and Barni, Mauro},
title = {Just Dance: detection of human body reenactment fake videos},
journal = {EURASIP Journal on Image and Video Processing},
year = {2024},
volume = {2024},
number = {1},
doi = {10.1186/s13640-024-00635-2}
}
EUVIMED