EUVIMEDEUVIMED entdecken
Crossref

AFFAKT: A Hierarchical Optimal Transport Based Method for Affective Facial Knowledge Transfer in Video Deception Detection

Zihan Ji, Xuetao Tian, Ye Liu

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (2) · 1336-1344

DOI: 10.1609/aaai.v39i2.32123 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Zihan Ji und 2 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The scarcity of high-quality large-scale labeled datasets poses a huge challenge for employing deep learning models in video deception detection. To address this issue, inspired by the psychological theory on the relation between deception and expressions, we propose a novel method called AFFAKT in this paper, which enhances the classification performance by transferring useful and correlated knowledge from a large facial expression dataset. Two key challenges in knowledge transfer arise: 1) how much knowledge of facial expression data should be transferred and 2) how to effectively leverage transferred knowledge for the deception classification model during inference. Specifically, the optimal relation mapping between facial expression classes and deception samples is firstly quantified using proposed H-OTKT module and then transfers knowledge from the facial expression dataset to deception samples. Moreover, a correlation prototype within another proposed module SRKB is well designed to retain the invariant correlations between facial expression classes and deception classes through momentum updating. During inference, the transferred knowledge is fine-tuned with the correlation prototype using a sample-specific re-weighting strategy. Experimental results on two deception detection datasets demonstrate the superior performance of our proposed method. The interpretability study reveals high associations between deception and negative affections, which coincides with the theory in psychology.

Zitieren

APA

Ji, Z., Tian, X., & Liu, Y. (2025). AFFAKT: A Hierarchical Optimal Transport Based Method for Affective Facial Knowledge Transfer in Video Deception Detection. Proceedings of the AAAI Conference on Artificial Intelligence, 39(2), 1336-1344. https://doi.org/10.1609/aaai.v39i2.32123

Vancouver

Ji Z, Tian X, Liu Y. AFFAKT: A Hierarchical Optimal Transport Based Method for Affective Facial Knowledge Transfer in Video Deception Detection. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(2):1336-1344. doi:10.1609/aaai.v39i2.32123

BibTeX
@article{Ji2025,
  author = {Ji, Zihan and Tian, Xuetao and Liu, Ye},
  title = {AFFAKT: A Hierarchical Optimal Transport Based Method for Affective Facial Knowledge Transfer in Video Deception Detection},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {2},
  pages = {1336--1344},
  doi = {10.1609/aaai.v39i2.32123}
}
Kostenlos starten →