EUVIMEDEUVIMED entdecken
Crossref

Boosting Micro-Expression Recognition via Self-Expression Reconstruction and Memory Contrastive Learning

Yongtang Bao, Chenxi Wu, Peng Zhang, Caifeng Shan, Yue Qi, Xianye Ben

IEEE Transactions on Affective Computing · 2024-10 · 15 (4) · 2083-2096

DOI: 10.1109/taffc.2024.3397701 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2024-10. Verfasst von Yongtang Bao und 5 weiteren Autor:innen. Die Arbeit wurde bisher 70-mal zitiert (Crossref) und nennt 61 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Micro-expression (ME) is an instinctive reaction that is not controlled by thoughts. It reveals one's inner feelings, which is significant in sentiment analysis and lie detection. Since micro-expression is expressed as subtle facial changes within particular facial action units, learning discriminative and generalized features for Micro-expression Recognition (MER) is challenging. To achieve the purpose, this paper proposes a novel MER framework that simultaneously integrates supervised Prototype-based Memory Contrastive Learning (PMCL) for discriminative feature mining and adds Self-expression Reconstruction (SER) as an auxiliary task and regularization for better generalization. In particular, the proposed SER module is forced as a regularization by reconstructing input ME from the randomly dropped patch- wise features in the bottleneck. And, the PMCL module globally compares historical and current cluster agents learned from training instances to enhance intra-class compactness and inter-class separability. Extensive experiments are conducted on three benchmarks, e.g., SMIC, CASME II, and SAMM, under evaluation criteria of both Composite Database Evaluation (CDE) and Single Database Evaluation (SDE) protocols. The results show our method surpasses other state-of-the-art approaches under various evaluation metrics, achieving overall 86.30% unweighed F1-score and 88.30% unweighed average recall on the composite dataset. Furthermore, the ablation studies verify the effectiveness of our SER for better generalization and PMCL for better discrimination in learning feature representation from limited micro-expression samples.

Zitieren

APA

Bao, Y., Wu, C., Zhang, P., Shan, C., Qi, Y., & Ben, X. (2024). Boosting Micro-Expression Recognition via Self-Expression Reconstruction and Memory Contrastive Learning. IEEE Transactions on Affective Computing, 15(4), 2083-2096. https://doi.org/10.1109/taffc.2024.3397701

Vancouver

Bao Y, Wu C, Zhang P, Shan C, Qi Y, Ben X. Boosting Micro-Expression Recognition via Self-Expression Reconstruction and Memory Contrastive Learning. IEEE Transactions on Affective Computing. 2024;15(4):2083-2096. doi:10.1109/taffc.2024.3397701

BibTeX
@article{Bao2024,
  author = {Bao, Yongtang and Wu, Chenxi and Zhang, Peng and Shan, Caifeng and Qi, Yue and Ben, Xianye},
  title = {Boosting Micro-Expression Recognition via Self-Expression Reconstruction and Memory Contrastive Learning},
  journal = {IEEE Transactions on Affective Computing},
  year = {2024},
  volume = {15},
  number = {4},
  pages = {2083--2096},
  doi = {10.1109/taffc.2024.3397701}
}
Kostenlos starten →