EUVIMEDDescobrir EUVIMED
Open access · CC BY 4.0

Frequency‐Aware Cue Fusion and Ensembled Prompt Learning for Unified Face Attack Detection With Vision–Language Model

Chaohao Jiang, Dang Li, Jing Gu, Yanyan Liang

IET Biometrics · 2026-01 · 2026 (1)

DOI: 10.1049/bme2/1941529 ↗

At a glance

Journal article in IET Biometrics, published online on 2026-03-08. Written by Chaohao Jiang and 3 co-authors. 65 references. The full text is freely available (open access, CC BY 4.0). Funded by: Macau University of Science and Technology.

ResumoDados bibliográficosCiteRelated studies

Abstract (original language)

Unified face attack detection (UAD) systems, which utilize vision–language models to simultaneously discriminate between physical and digital attacks, remain challenging due to the difficulty in effectively identifying live information and the biological cues forged by a variety of distinct technologies. The difficulty stems from two primary aspects: (1) Single spatial information is insufficient for capturing comprehensive cues regarding both genuine and forged identities. (2) Textual prompts struggle to acquire low‐redundancy and complementary information to facilitate the discrimination between live and fake cues. To address these issues, we propose a novel frequency‐aware and ensembled text prompt UAD model built upon the contrastive language‐image pretraining (CLIP) framework. Our model adaptively fuses spatial and frequency information to enhance the representation of genuine faces and all types of attacks, while simultaneously introducing an ensemble learning strategy to acquire low‐redundancy textual prompts. Specifically, the ensemble prompt module generates general live and fake prompts from spatial and frequency information on the language branch, thus guiding the model to learn a unified feature space to deal with different attacks. Meanwhile, this module optimizes the redundancy and complementarity between prompts through an ensemble strategy and a designed information diversity constraint. Furthermore, we design a layer‐wise cross‐attention module in the vision branch to fuse frequency information from different layers. A designed redundancy minimization module is employed on the fused image features, thereby compelling the spatial and frequency feature extraction modules to generate maximally exclusive features. Extensive experiments on multiple benchmarks demonstrate that our model achieves state‐of‐the‐art performance across most protocols of the datasets.

Funding

  • Macau University of Science and Technology

Cite

APA

Jiang, C., Li, D., Gu, J., & Liang, Y. (2026). Frequency‐Aware Cue Fusion and Ensembled Prompt Learning for Unified Face Attack Detection With Vision–Language Model. IET Biometrics, 2026(1). https://doi.org/10.1049/bme2/1941529

Vancouver

Jiang C, Li D, Gu J, Liang Y. Frequency‐Aware Cue Fusion and Ensembled Prompt Learning for Unified Face Attack Detection With Vision–Language Model. IET Biometrics. 2026;2026(1). doi:10.1049/bme2/1941529

BibTeX
@article{Jiang2026,
  author = {Jiang, Chaohao and Li, Dang and Gu, Jing and Liang, Yanyan},
  title = {Frequency‐Aware Cue Fusion and Ensembled Prompt Learning for Unified Face Attack Detection With Vision–Language Model},
  journal = {IET Biometrics},
  year = {2026},
  volume = {2026},
  number = {1},
  doi = {10.1049/bme2/1941529}
}
Start for free →