High-quality deepfakes have a heart!
Frontiers in Imaging · 30.04.2025 · 4
DOI: 10.3389/fimag.2025.1504551 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Imaging, online erschienen am 30.04.2025. Verfasst von Clemens Seibold und 5 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
Deepfakes have become ubiquitous in our modern society, with both their quantity and quality increasing. The current evolution of image generation techniques makes the detection of manipulated content through visual inspection increasingly difficult. This challenge has motivated researchers to analyze heart-beat-related signal to distinguish deep fakes from genuine videos.
Methods
In this study, we analyze deepfake videos of faces generated with novel methods regarding their heart-beat-related signals using remote photoplethysmography (rPPG). The rPPG signal describes the blood flow based, or rather local blood volume changes, and thus reflects the pulse signal. For our analysis, we present a pipeline that extracts rPPG signals and investigate the origin of the extracted signals in deepfake videos using correlation analyses. To validate our rPPG extraction pipeline and analyze rPPG signals of deepfakes, we captured a dataset of facial videos synchronized with an electrocardiogram (ECG) as a ground-truth pulse signal. Additionally, we generated high-quality deepfakes and incorporated publicly available datasets into our evaluation.
Results
We prove that our heart rate extraction pipeline produces valid estimates for genuine videos by comparing the estimated results with ECG reference data. Our high-quality deepfakes exhibit valid heart rates and their rPPG signals show a significant correlation with the corresponding driver video that was used to generate them. Furthermore, we show that this also holds for deepfakes from a publicly available dataset.
Discussion
Previous research assumed that the subtle heart-beat-related signals get lost during the deepfake generation process, making them useful for deepfake detection. However, this paper shows that this assumption is no longer valid for current deepfake methods. Nevertheless, preliminary experiments indicate that analyzing spatial distribution of bloodflow regarding its plausibility can still help to detect high quality deepfakes.
Zitieren
APA
Seibold, C., Wisotzky, E. L., Beckmann, A., Kossack, B., Hilsmann, A., & Eisert, P. (2025). High-quality deepfakes have a heart!. Frontiers in Imaging, 4. https://doi.org/10.3389/fimag.2025.1504551
Vancouver
Seibold C, Wisotzky EL, Beckmann A, Kossack B, Hilsmann A, Eisert P. High-quality deepfakes have a heart!. Frontiers in Imaging. 2025;4. doi:10.3389/fimag.2025.1504551
BibTeX
@article{Seibold2025,
author = {Seibold, Clemens and Wisotzky, Eric L. and Beckmann, Arian and Kossack, Benjamin and Hilsmann, Anna and Eisert, Peter},
title = {High-quality deepfakes have a heart!},
journal = {Frontiers in Imaging},
year = {2025},
volume = {4},
doi = {10.3389/fimag.2025.1504551}
}
EUVIMED