EUVIMEDEUVIMED entdecken
Crossref

Multi-Modal Deepfake Detection via Spatial, Temporal, and Audio-Visual Fusion with Vision Transformers

Merlin Gethsy D., Sharmila V.

Journal of Soft Computing Paradigm · 30.06.2026 · 8 (3) · 219-238

DOI: 10.36548/jscp.2026.3.003 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Soft Computing Paradigm, online erschienen am 30.06.2026. Verfasst von Merlin Gethsy D. und 1 weiteren Autor:innen. Die Arbeit nennt 15 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid advancement of the deepfake generation technologies has intensified concerns related to digital misinformation, identity impersonation, and media manipulation. Although numerous deepfake detection methods have been developed by mitigate these threats, most rely on a single modality and exhibit limited robustness when confronted with diverse manipulation techniques and cross-dataset scenarios. To overcome these deficiencies, we propose VeriSphere, a multimodal deepfake detection framework that combines spatial, temporal, and audiovisual forensics in one system. It uses a Vision Transformer for detecting spatial artifacts, an X-CLIP-based module for capturing temporality, and an AV synchronization module to examine whether speech aligns with lip movements. The outputs are then fused using a weighted strategy to produce a single trust score for prediction. Results show that VeriSphere achieves a high accuracy of 92.1%, an AUC of 0.963, and an F1-score of 0.924 across three benchmark datasets: FaceForensics++, Celeb-DF, and DFDC.

Zitieren

APA

D., M. G., & V., S. (2026). Multi-Modal Deepfake Detection via Spatial, Temporal, and Audio-Visual Fusion with Vision Transformers. Journal of Soft Computing Paradigm, 8(3), 219-238. https://doi.org/10.36548/jscp.2026.3.003

Vancouver

D. MG, V. S. Multi-Modal Deepfake Detection via Spatial, Temporal, and Audio-Visual Fusion with Vision Transformers. Journal of Soft Computing Paradigm. 2026;8(3):219-238. doi:10.36548/jscp.2026.3.003

BibTeX
@article{D2026,
  author = {D., Merlin Gethsy and V., Sharmila},
  title = {Multi-Modal Deepfake Detection via Spatial, Temporal, and Audio-Visual Fusion with Vision Transformers},
  journal = {Journal of Soft Computing Paradigm},
  year = {2026},
  volume = {8},
  number = {3},
  pages = {219--238},
  doi = {10.36548/jscp.2026.3.003}
}
Kostenlos starten →