EUVIMEDEUVIMED entdecken
Crossref

Learning Knowledge-Based Prompts for Robust 3D Mask Presentation Attack Detection

Fangling Jiang, Qi Li, Bing Liu, Weining Wang, Caifeng Shan, Zhenan Sun, Ming-Hsuan Yang

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026

DOI: 10.1109/tpami.2025.3618630 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026. Verfasst von Fangling Jiang und 6 weiteren Autor:innen. Hauptthemen laut MEDLINE: Machine Learning, Imaging, Three-Dimensional, Automated Facial Recognition, Biometric Identification. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 76 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Ministry of Education Research Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

3D mask presentation attack detection is crucial for protecting face recognition systems against the rising threat of 3D mask attacks. While most existing methods utilize multimodal features or remote photoplethysmography (rPPG) signals to distinguish between real faces and 3D masks, they face significant challenges, such as the high costs associated with multimodal sensors and limited generalization ability. Detection-related text descriptions offer concise, universal information and are cost-effective to obtain. However, the potential of vision-language multimodal features for 3D mask presentation attack detection remains unexplored. In this paper, we propose a novel knowledge-based prompt learning framework to explore the strong generalization capability of vision-language models for 3D mask presentation attack detection. Specifically, our approach incorporates entities and triples from knowledge graphs into the prompt learning process, generating fine-grained, task-specific explicit prompts that effectively harness the knowledge embedded in pre-trained vision-language models. Furthermore, considering different input images may emphasize distinct knowledge graph elements, we introduce a visual-specific knowledge filter based on an attention mechanism to refine relevant elements according to the visual context. Additionally, we leverage causal graph theory insights into the prompt learning process to further enhance the generalization ability of our method. During training, a spurious correlation elimination paradigm is employed, which removes category-irrelevant local image patches using guidance from knowledge-based text features, fostering the learning of generalized causal prompts that align with category-relevant local patches. Experimental results demonstrate that the proposed method achieves state-of-the-art intra- and cross-scenario detection performance on benchmark datasets.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Machine LearningImaging, Three-DimensionalAutomated Facial RecognitionBiometric IdentificationHumansAlgorithmsFace

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Ministry of Education Research Foundation
  • Natural Science Foundation of Hunan Province
  • Hengyang Science and Technology Plan Project
  • Interdisciplinary Research Program in Medicine and Engineering, The First Affiliated Hospital of University of South China

Zitieren

APA

Jiang, F., Li, Q., Liu, B., Wang, W., Shan, C., Sun, Z., & Yang, M. H. (2026). Learning Knowledge-Based Prompts for Robust 3D Mask Presentation Attack Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2025.3618630

Vancouver

Jiang F, Li Q, Liu B, Wang W, Shan C, Sun Z, et al. Learning Knowledge-Based Prompts for Robust 3D Mask Presentation Attack Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026. doi:10.1109/tpami.2025.3618630

BibTeX
@article{Jiang2026,
  author = {Jiang, Fangling and Li, Qi and Liu, Bing and Wang, Weining and Shan, Caifeng and Sun, Zhenan and Yang, Ming-Hsuan},
  title = {Learning Knowledge-Based Prompts for Robust 3D Mask Presentation Attack Detection},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2026},
  doi = {10.1109/tpami.2025.3618630}
}
Kostenlos starten →