EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ASL-MDFD: Adversarial Self-Supervised Learning for Generalizable GAN-Resilient Multimodal Deepfake Detection

Suryarprakash Nalluri, Aiman Shariff, Chethan T.P, Aisirii V Hegde, Indu Mahesh

International Journal of Global Innovations and Solutions · 2025

DOI: 10.63412/btg5gj03 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Global Innovations and Solutions, 2025. Verfasst von Suryarprakash Nalluri und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rise of hyper-realistic synthetic media generated by Generative Adversarial Networks (GANs) and diffusion models poses significant challenges to deepfake detection systems, particularly in cross-dataset and cross-GAN generalization. In this work, we propose ASL-MDFD: a novel framework that unifies Adversarial training, Self-Supervised Learning (SSL), and Multimodal Fusion to detect deepfakes across diverse sources. Our approach leverages rotation prediction, patch shuffling recovery, and contrastive audio-visual alignment as pretext tasks to learn intrinsic representations without heavy reliance on labels. Simultaneously, adversarially perturbed examples generated using PGD simulate artifacts from unseen GANs, improving model robustness. The multimodal architecture integrates visual, audio, and temporal streams using cross-modal attention to detect inconsistencies in facial textures, voice artifacts, and motion dynamics. Evaluated across FaceForensics++, DFDC, Celeb-DF, StyleGAN3, and StarGANv2 datasets, ASL-MDFD achieves state-of-the-art performance, including 92.3% AUC on Celeb-DF and 88.7% accuracy on StyleGAN3 fakes, significantly outperforming existing baselines. Our results demonstrate the effectiveness of combining SSL, adversarial resilience, and multimodal cues in building robust, generalizable deepfake detectors.

Zitieren

APA

Nalluri, S., Shariff, A., T.P, C., Hegde, A. V., & Mahesh, I. (2025). ASL-MDFD: Adversarial Self-Supervised Learning for Generalizable GAN-Resilient Multimodal Deepfake Detection. International Journal of Global Innovations and Solutions. https://doi.org/10.63412/btg5gj03

Vancouver

Nalluri S, Shariff A, T.P C, Hegde AV, Mahesh I. ASL-MDFD: Adversarial Self-Supervised Learning for Generalizable GAN-Resilient Multimodal Deepfake Detection. International Journal of Global Innovations and Solutions. 2025. doi:10.63412/btg5gj03

BibTeX
@article{Nalluri2025,
  author = {Nalluri, Suryarprakash and Shariff, Aiman and T.P, Chethan and Hegde, Aisirii V and Mahesh, Indu},
  title = {ASL-MDFD: Adversarial Self-Supervised Learning for Generalizable GAN-Resilient Multimodal Deepfake Detection},
  journal = {International Journal of Global Innovations and Solutions},
  year = {2025},
  doi = {10.63412/btg5gj03}
}
Kostenlos starten →