EUVIMEDEUVIMED entdecken
Crossref

Deepfake Video Detection Using Facial Feature Points and Ch-Transformer

Rui Yang, Rushi Lan, Zhenrong Deng, Xiaonan Luo, Xiyan Sun

ACM Transactions on Multimedia Computing, Communications, and Applications · 28.02.2025 · 21 (2) · 1-22

DOI: 10.1145/3672566 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 26.12.2024. Verfasst von Rui Yang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: Guangxi Science and Technology Project, National Natural Science Foundation of China, Guangxi Key Laboratory of Image and Graphic Intelligent Processing Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the development of Metaverse technology, the avatar in Metaverse has faced serious security and privacy concerns. Analyzing facial features to distinguish between genuine and manipulated facial videos holds significant research importance for ensuring the authenticity of characters in the virtual world and for mitigating discrimination as well as preventing malicious use of facial data. To address this issue, the Facial Feature Points and Class-head-Transformer (FFP-ChT) deepfake video detection model is designed based on the clues of different FFPs distribution in real and fake videos and different displacement distances of real and fake FFPs between frames. The face video input is first detected by the BlazeFace model, and the face detection results are fed into the FaceMesh model to extract 468 FFPs. Then, the Lucas–Kanade (LK) optical flow method is used to track the points of the face, the face calibration algorithm is introduced to re-calibrate the FFPs, and the jitter displacement is calculated by tracking the FFPs between frames. Finally, the Ch is designed in the transformer, and the FFPs and FFP displacement are jointly classified through the ChT model. In this way, the designed ChT classifier is able to accurately and effectively identify deepfake videos. Experiments on open datasets clearly demonstrate the effectiveness and generalization capabilities of our approach.

Förderung

  • Guangxi Science and Technology Project
  • National Natural Science Foundation of China
  • Guangxi Key Laboratory of Image and Graphic Intelligent Processing Project
  • Innovation Project of GUET Graduate Education

Zitieren

APA

Yang, R., Lan, R., Deng, Z., Luo, X., & Sun, X. (2025). Deepfake Video Detection Using Facial Feature Points and Ch-Transformer. ACM Transactions on Multimedia Computing, Communications, and Applications, 21(2), 1-22. https://doi.org/10.1145/3672566

Vancouver

Yang R, Lan R, Deng Z, Luo X, Sun X. Deepfake Video Detection Using Facial Feature Points and Ch-Transformer. ACM Transactions on Multimedia Computing, Communications, and Applications. 2025;21(2):1-22. doi:10.1145/3672566

BibTeX
@article{Yang2025,
  author = {Yang, Rui and Lan, Rushi and Deng, Zhenrong and Luo, Xiaonan and Sun, Xiyan},
  title = {Deepfake Video Detection Using Facial Feature Points and Ch-Transformer},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2025},
  volume = {21},
  number = {2},
  pages = {1--22},
  doi = {10.1145/3672566}
}
Kostenlos starten →