Facial and Neck Region Analysis for Deepfake Detection Using Remote Photoplethysmography Signal Similarity
IET Biometrics · 2024-01 · 2024 (1)
DOI: 10.1049/bme2/7095412 ↗Kurz gefasst
Fachartikel in der Zeitschrift IET Biometrics, online erschienen am 21.11.2024. Verfasst von Byeong Seon An und 3 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science, ICT and Future Planning, Korea Customs Service.
Abstract (Originalsprache)
Deepfake (DF) involves utilizing artificial intelligence (AI) technology to synthesize or manipulate images, voices, and other human or object data. However, recent times have seen a surge in instances of DF technology misuse, raising concerns about cybercrime and the credibility of manipulated information. The objective of this study is to devise a method that employs remote photoplethysmography (rPPG) biosignals for DF detection. The face was divided into five regions based on landmarks, with automatic extraction performed on the neck region. We conducted rPPG signal extraction from each facial area and the neck region was defined as the ground truth. The five signals extracted from the face were used as inputs to an support vector machine (SVM) model by calculating the euclidean distance between each signal and the signal extracted from the neck region, measuring rPPG signal similarity with five features. Our approach demonstrated robust performance with an area under the curve (AUC) score of 91.2% on the audio‐driven dataset and 99.7% on the face swapping generative adversarial network (FSGAN) dataset, even though we only used datasets excluding DF techniques that can be visually identified in Korean DF Detection Dataset (KoDF). Therefore, our research findings demonstrate that similarity features of rPPG signals can be utilized as key features for detecting DFs.
Förderung
- Ministry of Science, ICT and Future Planning
- Korea Customs Service
Zitieren
APA
An, B. S., Lim, H., Seong, H. A., & Lee, E. C. (2024). Facial and Neck Region Analysis for Deepfake Detection Using Remote Photoplethysmography Signal Similarity. IET Biometrics, 2024(1). https://doi.org/10.1049/bme2/7095412
Vancouver
An BS, Lim H, Seong HA, Lee EC. Facial and Neck Region Analysis for Deepfake Detection Using Remote Photoplethysmography Signal Similarity. IET Biometrics. 2024;2024(1). doi:10.1049/bme2/7095412
BibTeX
@article{An2024,
author = {An, Byeong Seon and Lim, Hyeji and Seong, Hyeon Ah and Lee, Eui Chul},
title = {Facial and Neck Region Analysis for Deepfake Detection Using Remote Photoplethysmography Signal Similarity},
journal = {IET Biometrics},
year = {2024},
volume = {2024},
number = {1},
doi = {10.1049/bme2/7095412}
}
EUVIMED