Wavelet-Enhanced CLIP with Noise Residual Learning for Generalizable Deepfake Detection
Mathematics · 03.11.2026 · 14 (21) · 4010
DOI: 10.3390/math14214010 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 03.11.2026. Verfasst von Yuan Rao und 5 weiteren Autor:innen. Die Arbeit nennt 66 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Guangdong Basic and Applied Basic Research Foundation, Guangzhou Basic and Applied Basic Research Project.
Abstract (Originalsprache)
The rapid development of artificial intelligence-generated content (AIGC) methods has posed severe threats to security and privacy, as photorealistic face forgeries (deepfakes) can be easily generated by modern generative models. Since existing CLIP-based deepfake detection methods mainly focus on high-level semantic information, they may struggle to capture subtle tampering artifacts in the frequency domain, leading to unsatisfactory generalization ability. To address this issue, in this paper, a frequency-aware deepfake detection network, which is composed of a CLIP-based semantic branch and a residual-based noise branch, is proposed to jointly capture forgery traces in the spatial and frequency domains. In the semantic branch, a wavelet convolution module is incorporated with the image encoder of CLIP to enhance multi-frequency representations. To characterize statistical inconsistencies around forged boundaries, a constrained convolutional layer and a noise encoder are adopted to extract residual features, which are fused with semantic features through learnable weighted fusion. To further improve generalization ability, an image–text class prototype alignment strategy is proposed to align the fused visual features with text embeddings of pre-defined prompts corresponding to specific classes. Extensive experimental results on several benchmark datasets demonstrate that the proposed method achieves competitive performance against other state-of-the-art methods on cross-dataset evaluations.
Förderung
- National Natural Science Foundation of China
- Guangdong Basic and Applied Basic Research Foundation
- Guangzhou Basic and Applied Basic Research Project
Zitieren
APA
Rao, Y., Zeng, J., Tang, W., Chen, K., Ran, C., & Zeng, H. (2026). Wavelet-Enhanced CLIP with Noise Residual Learning for Generalizable Deepfake Detection. Mathematics, 14(21), 4010. https://doi.org/10.3390/math14214010
Vancouver
Rao Y, Zeng J, Tang W, Chen K, Ran C, Zeng H. Wavelet-Enhanced CLIP with Noise Residual Learning for Generalizable Deepfake Detection. Mathematics. 2026;14(21):4010. doi:10.3390/math14214010
BibTeX
@article{Rao2026,
author = {Rao, Yuan and Zeng, Jianhui and Tang, Weixuan and Chen, Kongyang and Ran, Cheng and Zeng, Haozhe},
title = {Wavelet-Enhanced CLIP with Noise Residual Learning for Generalizable Deepfake Detection},
journal = {Mathematics},
year = {2026},
volume = {14},
number = {21},
pages = {4010},
doi = {10.3390/math14214010}
}
EUVIMED