EUVIMEDEUVIMED entdecken
Crossref

Facial Prior Guided Micro-Expression Generation

Yi Zhang, Xinhua Xu, Youjun Zhao, Yuhang Wen, Zixuan Tang, Mengyuan Liu

IEEE Transactions on Image Processing · 2024 · 33 · 525-540

DOI: 10.1109/tip.2023.3345177 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2024. Verfasst von Yi Zhang und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: Facial Expression, Face. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 83 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Shenzhen.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper focuses on the facial micro-expression (FME) generation task, which has potential application in enlarging digital FME datasets, thereby alleviating the lack of training data with labels in existing micro-expression datasets. Despite obvious progress in the image animation task, FME generation remains challenging because existing image animation methods can hardly encode subtle and short-term facial motion information. To this end, we present a facial-prior-guided FME generation framework that takes advantage of facial priors for facial motion generation. Specifically, we first estimate the geometric locations of action units (AUs) with detected facial landmarks. We further calculate an adaptive weighted prior (AWP) map, which alleviates the estimation error of AUs while efficiently capturing subtle facial motion patterns. To achieve smooth and realistic synthesis results, we use our proposed facial prior module to guide motion representation and generation modules in mainstream image animation frameworks. Extensive experiments on three benchmark datasets consistently show that our proposed facial prior module can be adopted in image animation frameworks and significantly improve their performance on micro-expression generation. Moreover, we use the generation technique to enlarge existing datasets, thereby improving the performance of general action recognition backbones on the FME recognition task. Our code is available at https://github.com/sysu19351158/FPB-FOMM.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Facial ExpressionFace

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Shenzhen

Zitieren

APA

Zhang, Y., Xu, X., Zhao, Y., Wen, Y., Tang, Z., & Liu, M. (2024). Facial Prior Guided Micro-Expression Generation. IEEE Transactions on Image Processing, 33, 525-540. https://doi.org/10.1109/tip.2023.3345177

Vancouver

Zhang Y, Xu X, Zhao Y, Wen Y, Tang Z, Liu M. Facial Prior Guided Micro-Expression Generation. IEEE Transactions on Image Processing. 2024;33:525-540. doi:10.1109/tip.2023.3345177

BibTeX
@article{Zhang2024,
  author = {Zhang, Yi and Xu, Xinhua and Zhao, Youjun and Wen, Yuhang and Tang, Zixuan and Liu, Mengyuan},
  title = {Facial Prior Guided Micro-Expression Generation},
  journal = {IEEE Transactions on Image Processing},
  year = {2024},
  volume = {33},
  pages = {525--540},
  doi = {10.1109/tip.2023.3345177}
}
Kostenlos starten →