EUVIMEDEUVIMED entdecken
Crossref

CFAN-SDA: Coarse-Fine Aware Network With Static-Dynamic Adaptation for Facial Expression Recognition in Videos

Dongliang Chen, Guihua Wen, Pei Yang, Huihui Li, Chuyun Chen, Bao Wang

IEEE Transactions on Circuits and Systems for Video Technology · 2024-12 · 34 (12) · 13507-13517

DOI: 10.1109/tcsvt.2024.3450652 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-12. Verfasst von Dongliang Chen und 5 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 62 Literaturangaben. Gefördert von: China National Science Foundation, Guangdong Province Key Area Research and Development Plan Project, Guangzhou Science and Technology Planning Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Video-based facial expression recognition (FER) is a challenging task due to the dynamic emotional changes with variant frames in video sequences. This paper proposes a novel coarse-fine aware network with static-dynamic adaptation (CFAN-SDA) for in-the wild video-based FER. From coarse to fine, our method leverages cross-domain static FER database to boost video-based FER performance, and then explore hierarchical spatial-temporal feature learning. Specifically, different from existing methods, we design a static-dynamic adaptation learning to explore the knowledge transfer from labeled static images to unlabeled frames of video, which captures the features of coarse-grained emotion to find those important expression-related frames. Furthermore, we present hierarchical spatial-temporal transformers to better learn features of fine-grained expression, which consist of multi-view spatial transformer and frame-clip temporal transformer. The former captures multi-view spatial regions information from global to local, and the latter achieves cross-frame and cross-clip temporal interaction to select the key frame-level and clip-level multi-scale temporal information for fusing. Extensive experimental results on dynamic FER databases indicate that CFAN-SDA achieves superior performance compared to the state-of-the-art models.

Förderung

  • China National Science Foundation
  • Guangdong Province Key Area Research and Development Plan Project
  • Guangzhou Science and Technology Planning Project
  • Basic and Applied Basic Research Foundation of Guangdong Province
  • Project of Education Department of Guangdong Province

Zitieren

APA

Chen, D., Wen, G., Yang, P., Li, H., Chen, C., & Wang, B. (2024). CFAN-SDA: Coarse-Fine Aware Network With Static-Dynamic Adaptation for Facial Expression Recognition in Videos. IEEE Transactions on Circuits and Systems for Video Technology, 34(12), 13507-13517. https://doi.org/10.1109/tcsvt.2024.3450652

Vancouver

Chen D, Wen G, Yang P, Li H, Chen C, Wang B. CFAN-SDA: Coarse-Fine Aware Network With Static-Dynamic Adaptation for Facial Expression Recognition in Videos. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(12):13507-13517. doi:10.1109/tcsvt.2024.3450652

BibTeX
@article{Chen2024,
  author = {Chen, Dongliang and Wen, Guihua and Yang, Pei and Li, Huihui and Chen, Chuyun and Wang, Bao},
  title = {CFAN-SDA: Coarse-Fine Aware Network With Static-Dynamic Adaptation for Facial Expression Recognition in Videos},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {12},
  pages = {13507--13517},
  doi = {10.1109/tcsvt.2024.3450652}
}
Kostenlos starten →