CFAN-SDA: Coarse-Fine Aware Network With Static-Dynamic Adaptation for Facial Expression Recognition in Videos
IEEE Transactions on Circuits and Systems for Video Technology · 2024-12 · 34 (12) · 13507-13517
DOI: 10.1109/tcsvt.2024.3450652 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-12. Verfasst von Dongliang Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: China National Science Foundation, Guangdong Province Key Area Research and Development Plan Project, Guangzhou Science and Technology Planning Project.
Abstract (Originalsprache)
Video-based facial expression recognition (FER) is a challenging task due to the dynamic emotional changes with variant frames in video sequences. This paper proposes a novel coarse-fine aware network with static-dynamic adaptation (CFAN-SDA) for in-the wild video-based FER. From coarse to fine, our method leverages cross-domain static FER database to boost video-based FER performance, and then explore hierarchical spatial-temporal feature learning. Specifically, different from existing methods, we design a static-dynamic adaptation learning to explore the knowledge transfer from labeled static images to unlabeled frames of video, which captures the features of coarse-grained emotion to find those important expression-related frames. Furthermore, we present hierarchical spatial-temporal transformers to better learn features of fine-grained expression, which consist of multi-view spatial transformer and frame-clip temporal transformer. The former captures multi-view spatial regions information from global to local, and the latter achieves cross-frame and cross-clip temporal interaction to select the key frame-level and clip-level multi-scale temporal information for fusing. Extensive experimental results on dynamic FER databases indicate that CFAN-SDA achieves superior performance compared to the state-of-the-art models.
Förderung
- China National Science Foundation
- Guangdong Province Key Area Research and Development Plan Project
- Guangzhou Science and Technology Planning Project
- Basic and Applied Basic Research Foundation of Guangdong Province
- Project of Education Department of Guangdong Province
Zitieren
APA
Chen, D., Wen, G., Yang, P., Li, H., Chen, C., & Wang, B. (2024). CFAN-SDA: Coarse-Fine Aware Network With Static-Dynamic Adaptation for Facial Expression Recognition in Videos. IEEE Transactions on Circuits and Systems for Video Technology, 34(12), 13507-13517. https://doi.org/10.1109/tcsvt.2024.3450652
Vancouver
Chen D, Wen G, Yang P, Li H, Chen C, Wang B. CFAN-SDA: Coarse-Fine Aware Network With Static-Dynamic Adaptation for Facial Expression Recognition in Videos. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(12):13507-13517. doi:10.1109/tcsvt.2024.3450652
BibTeX
@article{Chen2024,
author = {Chen, Dongliang and Wen, Guihua and Yang, Pei and Li, Huihui and Chen, Chuyun and Wang, Bao},
title = {CFAN-SDA: Coarse-Fine Aware Network With Static-Dynamic Adaptation for Facial Expression Recognition in Videos},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {12},
pages = {13507--13517},
doi = {10.1109/tcsvt.2024.3450652}
}
EUVIMED