Multi-Modal Deepfake Detection via Spatial, Temporal, and Audio-Visual Fusion with Vision Transformers
Journal of Soft Computing Paradigm · 30.06.2026 · 8 (3) · 219-238
DOI: 10.36548/jscp.2026.3.003 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Soft Computing Paradigm, online erschienen am 30.06.2026. Verfasst von Merlin Gethsy D. und 1 weiteren Autor:innen. Die Arbeit nennt 15 Literaturangaben.
Abstract (Originalsprache)
The rapid advancement of the deepfake generation technologies has intensified concerns related to digital misinformation, identity impersonation, and media manipulation. Although numerous deepfake detection methods have been developed by mitigate these threats, most rely on a single modality and exhibit limited robustness when confronted with diverse manipulation techniques and cross-dataset scenarios. To overcome these deficiencies, we propose VeriSphere, a multimodal deepfake detection framework that combines spatial, temporal, and audiovisual forensics in one system. It uses a Vision Transformer for detecting spatial artifacts, an X-CLIP-based module for capturing temporality, and an AV synchronization module to examine whether speech aligns with lip movements. The outputs are then fused using a weighted strategy to produce a single trust score for prediction. Results show that VeriSphere achieves a high accuracy of 92.1%, an AUC of 0.963, and an F1-score of 0.924 across three benchmark datasets: FaceForensics++, Celeb-DF, and DFDC.
Zitieren
APA
D., M. G., & V., S. (2026). Multi-Modal Deepfake Detection via Spatial, Temporal, and Audio-Visual Fusion with Vision Transformers. Journal of Soft Computing Paradigm, 8(3), 219-238. https://doi.org/10.36548/jscp.2026.3.003
Vancouver
D. MG, V. S. Multi-Modal Deepfake Detection via Spatial, Temporal, and Audio-Visual Fusion with Vision Transformers. Journal of Soft Computing Paradigm. 2026;8(3):219-238. doi:10.36548/jscp.2026.3.003
BibTeX
@article{D2026,
author = {D., Merlin Gethsy and V., Sharmila},
title = {Multi-Modal Deepfake Detection via Spatial, Temporal, and Audio-Visual Fusion with Vision Transformers},
journal = {Journal of Soft Computing Paradigm},
year = {2026},
volume = {8},
number = {3},
pages = {219--238},
doi = {10.36548/jscp.2026.3.003}
}
EUVIMED