EUVIMEDEUVIMED entdecken
Crossref

Reliable and Balanced Transfer Learning for Generalized Multimodal Face Anti-Spoofing

Xun Lin, Ajian Liu, Zitong Yu, Rizhao Cai, Shuai Wang, Yi Yu, Jun Wan, Zhen Lei, Xiaochun Cao, Alex Kot

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025-09 · 47 (9) · 7608-7625

DOI: 10.1109/tpami.2025.3573785 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025-09. Verfasst von Xun Lin und 9 weiteren Autor:innen. Die Arbeit wurde bisher 43-mal zitiert (Crossref) und nennt 79 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Key Research and Development Program of China, InnoHK program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Face Anti-Spoofing (FAS) is essential for securing face recognition systems against presentation attacks. Recent advances in sensor technology and multimodal learning have enabled the development of multimodal FAS systems. However, existing methods often struggle to generalize to unseen attacks and diverse environments due to two key challenges: (1) Modality unreliability, where sensors such as depth and infrared suffer from severe domain shifts, impairing the reliability of cross-modal fusion; and (2) Modality imbalance, where over-reliance on a dominant modality weakens the model's robustness against attacks that affect other modalities. To overcome these issues, we propose MMDG++, a multimodal domain-generalized FAS framework built upon the vision-language model CLIP. In MMDG++, we design the Uncertainty-Guided Cross-Adapter++ (U-Adapter++) to filter out unreliable regions within each modality, enabling more reliable multimodal interactions. Additionally, we introduce Rebalanced Modality Gradient Modulation (ReGrad) for adaptive gradient modulation to balance modality convergence. To further enhance generalization, propose Asymmetric Domain Prompts (ADPs) that leverage CLIP's language priors to learn generalized decision boundaries across modalities. We also develop a novel multimodal FAS benchmark to evaluate generalizability under various deployment conditions. Extensive experiments across this benchmark show our method outperforms state-of-the-art FAS methods, demonstrating superior generalization capability.

Förderung

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China
  • InnoHK program
  • SongShan Lake HPC Center
  • Great Bay University
  • Science and Technology Development Fund of Macau
  • Medical Science and Technology Foundation of Guangdong Province
  • Shenzhen Science and Technology Program

Zitieren

APA

Lin, X., Liu, A., Yu, Z., Cai, R., Wang, S., Yu, Y., Wan, J., Lei, Z., Cao, X., & Kot, A. (2025). Reliable and Balanced Transfer Learning for Generalized Multimodal Face Anti-Spoofing. IEEE Transactions on Pattern Analysis and Machine Intelligence, 47(9), 7608-7625. https://doi.org/10.1109/tpami.2025.3573785

Vancouver

Lin X, Liu A, Yu Z, Cai R, Wang S, Yu Y, et al. Reliable and Balanced Transfer Learning for Generalized Multimodal Face Anti-Spoofing. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025;47(9):7608-7625. doi:10.1109/tpami.2025.3573785

BibTeX
@article{Lin2025,
  author = {Lin, Xun and Liu, Ajian and Yu, Zitong and Cai, Rizhao and Wang, Shuai and Yu, Yi and Wan, Jun and Lei, Zhen and Cao, Xiaochun and Kot, Alex},
  title = {Reliable and Balanced Transfer Learning for Generalized Multimodal Face Anti-Spoofing},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  volume = {47},
  number = {9},
  pages = {7608--7625},
  doi = {10.1109/tpami.2025.3573785}
}
Kostenlos starten →