Boosting Deepfake Detection Generalizability via Expansive Learning and Confidence Judgement
IEEE Transactions on Circuits and Systems for Video Technology · 2025-01 · 35 (1) · 953-966
DOI: 10.1109/tcsvt.2024.3462985 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2025-01. Verfasst von Kuiyuan Zhang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 64 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Guangdong Basic and Applied Basic Research Foundation, Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies.
Abstract (Originalsprache)
As deepfake technology poses severe threats to information security, significant efforts have been devoted to deepfake detection. To enable model generalization for detecting new types of deepfakes, it is required that the existing models should learn knowledge about new types of deepfakes without losing prior knowledge, a challenge known as catastrophic forgetting (CF). Existing methods mainly utilize domain adaptation to learn about the new deepfakes for addressing this issue. However, these methods are constrained to utilizing a small portion of data samples from the new deepfakes, and they suffer from CF when the size of the data samples used for domain adaptation increases. This resulted in poor average performance in source and target domains. In this paper, we introduce a novel approach to boost the generalizability of deepfake detection. Our approach follows a two-stage training process: training in the source domain (prior deepfakes that have been used for training) and domain adaptation to the target domain (new types of deepfakes). In the first stage, we employ expansive learning to train our expanded model from a well-trained teacher model. In the second stage, we transfer the expanded model to the target domain while removing assistant components. For model architecture, we propose the frequency extraction module to extract frequency features as complementary to spatial features and introduce spatial-frequency contrastive loss to enhance feature learning ability. Moreover, we develop a confidence judgement module to eliminate conflicts between new and prior knowledge. Experimental results demonstrate that our method can achieve better average accuracy in source and target domains even when using large-scale data samples of the target domain, and it exhibits superior generalizability compared to state-of-the-art methods.
Förderung
- National Natural Science Foundation of China
- Guangdong Basic and Applied Basic Research Foundation
- Guangdong Provincial Key Laboratory of Novel Security Intelligence Technologies
- Shenzhen Science and Technology Program
Zitieren
APA
Zhang, K., Hou, Z., Hua, Z., Zheng, Y., & Zhang, L. Y. (2025). Boosting Deepfake Detection Generalizability via Expansive Learning and Confidence Judgement. IEEE Transactions on Circuits and Systems for Video Technology, 35(1), 953-966. https://doi.org/10.1109/tcsvt.2024.3462985
Vancouver
Zhang K, Hou Z, Hua Z, Zheng Y, Zhang LY. Boosting Deepfake Detection Generalizability via Expansive Learning and Confidence Judgement. IEEE Transactions on Circuits and Systems for Video Technology. 2025;35(1):953-966. doi:10.1109/tcsvt.2024.3462985
BibTeX
@article{Zhang2025,
author = {Zhang, Kuiyuan and Hou, Zeming and Hua, Zhongyun and Zheng, Yifeng and Zhang, Leo Yu},
title = {Boosting Deepfake Detection Generalizability via Expansive Learning and Confidence Judgement},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2025},
volume = {35},
number = {1},
pages = {953--966},
doi = {10.1109/tcsvt.2024.3462985}
}
EUVIMED