Reliable and Balanced Transfer Learning for Generalized Multimodal Face Anti-Spoofing
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-09 · 47 (9) · 7608-7625
DOI: 10.1109/tpami.2025.3573785 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-09. Verfasst von Xun Lin und 9 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 79 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, InnoHK program.
Abstract (Originalsprache)
Face Anti-Spoofing (FAS) is essential for securing face recognition systems against presentation attacks. Recent advances in sensor technology and multimodal learning have enabled the development of multimodal FAS systems. However, existing methods often struggle to generalize to unseen attacks and diverse environments due to two key challenges: (1) Modality unreliability, where sensors such as depth and infrared suffer from severe domain shifts, impairing the reliability of cross-modal fusion; and (2) Modality imbalance, where over-reliance on a dominant modality weakens the model's robustness against attacks that affect other modalities. To overcome these issues, we propose MMDG++, a multimodal domain-generalized FAS framework built upon the vision-language model CLIP. In MMDG++, we design the Uncertainty-Guided Cross-Adapter++ (U-Adapter++) to filter out unreliable regions within each modality, enabling more reliable multimodal interactions. Additionally, we introduce Rebalanced Modality Gradient Modulation (ReGrad) for adaptive gradient modulation to balance modality convergence. To further enhance generalization, propose Asymmetric Domain Prompts (ADPs) that leverage CLIP's language priors to learn generalized decision boundaries across modalities. We also develop a novel multimodal FAS benchmark to evaluate generalizability under various deployment conditions. Extensive experiments across this benchmark show our method outperforms state-of-the-art FAS methods, demonstrating superior generalization capability.
Förderung
- National Natural Science Foundation of China
- National Key Research and Development Program of China
- InnoHK program
- SongShan Lake HPC Center
- Great Bay University
- Science and Technology Development Fund of Macau
- Medical Science and Technology Foundation of Guangdong Province
- Shenzhen Science and Technology Program
Zitieren
APA
Lin, X., Liu, A., Yu, Z., Cai, R., Wang, S., Yu, Y., Wan, J., Lei, Z., Cao, X., & Kot, A. (2025). Reliable and Balanced Transfer Learning for Generalized Multimodal Face Anti-Spoofing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(9), 7608-7625. https://doi.org/10.1109/tpami.2025.3573785
Vancouver
Lin X, Liu A, Yu Z, Cai R, Wang S, Yu Y, et al. Reliable and Balanced Transfer Learning for Generalized Multimodal Face Anti-Spoofing. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(9):7608-7625. doi:10.1109/tpami.2025.3573785
BibTeX
@article{Lin2025,
author = {Lin, Xun and Liu, Ajian and Yu, Zitong and Cai, Rizhao and Wang, Shuai and Yu, Yi and Wan, Jun and Lei, Zhen and Cao, Xiaochun and Kot, Alex},
title = {Reliable and Balanced Transfer Learning for Generalized Multimodal Face Anti-Spoofing},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2025},
volume = {47},
number = {9},
pages = {7608--7625},
doi = {10.1109/tpami.2025.3573785}
}
EUVIMED