Facial Prior Guided Micro-Expression Generation
IEEE Transactions on Image Processing · 2024 · 33 · 525-540
DOI: 10.1109/tip.2023.3345177 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2024. Verfasst von Yi Zhang und 5 weiteren Autor:innen. Hauptthemen laut MEDLINE: Facial Expression, Face. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 83 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Shenzhen.
Abstract (Originalsprache)
This paper focuses on the facial micro-expression (FME) generation task, which has potential application in enlarging digital FME datasets, thereby alleviating the lack of training data with labels in existing micro-expression datasets. Despite obvious progress in the image animation task, FME generation remains challenging because existing image animation methods can hardly encode subtle and short-term facial motion information. To this end, we present a facial-prior-guided FME generation framework that takes advantage of facial priors for facial motion generation. Specifically, we first estimate the geometric locations of action units (AUs) with detected facial landmarks. We further calculate an adaptive weighted prior (AWP) map, which alleviates the estimation error of AUs while efficiently capturing subtle facial motion patterns. To achieve smooth and realistic synthesis results, we use our proposed facial prior module to guide motion representation and generation modules in mainstream image animation frameworks. Extensive experiments on three benchmark datasets consistently show that our proposed facial prior module can be adopted in image animation frameworks and significantly improve their performance on micro-expression generation. Moreover, we use the generation technique to enlarge existing datasets, thereby improving the performance of general action recognition backbones on the FME recognition task. Our code is available at https://github.com/sysu19351158/FPB-FOMM.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Shenzhen
Zitieren
APA
Zhang, Y., Xu, X., Zhao, Y., Wen, Y., Tang, Z., & Liu, M. (2024). Facial Prior Guided Micro-Expression Generation. IEEE Transactions on Image Processing, 33, 525-540. https://doi.org/10.1109/tip.2023.3345177
Vancouver
Zhang Y, Xu X, Zhao Y, Wen Y, Tang Z, Liu M. Facial Prior Guided Micro-Expression Generation. IEEE Transactions on Image Processing. 2024;33:525-540. doi:10.1109/tip.2023.3345177
BibTeX
@article{Zhang2024,
author = {Zhang, Yi and Xu, Xinhua and Zhao, Youjun and Wen, Yuhang and Tang, Zixuan and Liu, Mengyuan},
title = {Facial Prior Guided Micro-Expression Generation},
journal = {IEEE Transactions on Image Processing},
year = {2024},
volume = {33},
pages = {525--540},
doi = {10.1109/tip.2023.3345177}
}
EUVIMED