EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Audio–Visual Synchronization and Lip Movement Analysis for Real-Time Deepfake Detection

Muhammad Javed, Zhaohui Zhang, Fida Hussain Dahri, Asif Ali Laghari, Martin Krajčík, Ahmad Almadhor

International Journal of Computational Intelligence Systems · 07.07.2025 · 18 (1)

DOI: 10.1007/s44196-025-00911-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computational Intelligence Systems, online erschienen am 07.07.2025. Verfasst von Muhammad Javed und 5 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 89 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid advancements in Artificial Intelligence (AI) and deep learning techniques have led to the creation of highly realistic synthetic media known as deepfakes. These manipulated images, videos, and audio pose significant ethical, security, and privacy concerns. To address this issue, we propose a novel Audio–Visual Synchronisation and Fusion Framework (AVSFF) for real-time detection of deepfakes. This approach focuses on fine-grained lip movement analysis by detecting subtle inconsistencies between lip movements and corresponding audio. By integrating visual and audio features using multimodal fusion techniques, AVSFF aims to distinguish between authentic and manipulated media. The proposed framework is evaluated on diverse datasets, including FakeAVCeleb, AV-Deepfake1M, TVIL, and LAV-DF, demonstrating promising results with accuracies of 0.9973, 0.9760, 0.9890, and 0.9786, respectively. This study contributes to the field by providing a robust real-time solution for detecting deepfakes in audio–visual synthetic data, ensuring enhanced detection accuracy and effective generalization across various deepfake manipulations and demographic data.

Zitieren

APA

Javed, M., Zhang, Z., Dahri, F. H., Laghari, A. A., Krajčík, M., & Almadhor, A. (2025). Audio–Visual Synchronization and Lip Movement Analysis for Real-Time Deepfake Detection. International Journal of Computational Intelligence Systems, 18(1). https://doi.org/10.1007/s44196-025-00911-7

Vancouver

Javed M, Zhang Z, Dahri FH, Laghari AA, Krajčík M, Almadhor A. Audio–Visual Synchronization and Lip Movement Analysis for Real-Time Deepfake Detection. International Journal of Computational Intelligence Systems. 2025;18(1). doi:10.1007/s44196-025-00911-7

BibTeX
@article{Javed2025,
  author = {Javed, Muhammad and Zhang, Zhaohui and Dahri, Fida Hussain and Laghari, Asif Ali and Krajčík, Martin and Almadhor, Ahmad},
  title = {Audio–Visual Synchronization and Lip Movement Analysis for Real-Time Deepfake Detection},
  journal = {International Journal of Computational Intelligence Systems},
  year = {2025},
  volume = {18},
  number = {1},
  doi = {10.1007/s44196-025-00911-7}
}
Kostenlos starten →