Probabilistic Attribute Tree Structured Convolutional Neural Networks for Facial Expression Recognition in the Wild
IEEE Transactions on Affective Computing · 01.07.2023 · 14 (3) · 1927-1941
DOI: 10.1109/taffc.2022.3156920 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, erschienen am 01.07.2023. Verfasst von Jie Cai und 5 weiteren Autor:innen. Die Arbeit wurde bisher 44-mal zitiert (Crossref) und nennt 99 Literaturangaben. Gefördert von: National Science Foundation.
Abstract (Originalsprache)
Very recent work has demonstrated tremendous improvements in facial expression recognition (FER) on laboratory-controlled datasets. However, recognizing facial expressions under in-the-wild conditions still remains challenging, especially on unseen subjects due to high inter-subject variations. In this paper, we propose a novel Probabilistic Attribute Tree Convolutional Neural Network (PAT-CNN) to explicitly deal with large intra-class variations caused by identity-related attributes, e.g., age, race, and gender. Specifically, a PAT module with an associated PAT loss is proposed to learn features in a hierarchical tree structure organized according to identity-related attributes, where the final features are less affected by the attributes. Then, expression-related features are extracted from leaf nodes. Samples are probabilistically assigned to tree nodes at different levels such that expression-related features can be learned from all samples weighted by probabilities. Furthermore, the proposed PAT-CNN can be learned from limited attribute-annotated samples to make the best use of available data. Experimental results on four spontaneous facial expression datasets, i.e., RAF-DB, SFEW, ExpW, and FER-2013, have demonstrated that the proposed PAT-CNN achieves the best performance when compared to state-of-the-art methods by explicitly modeling attributes. Impressively, a single model PAT-CNN achieves the best performance on the SFEW test dataset when compared to the state-of-the-art methods using an ensemble of hundreds of CNNs.
Förderung
- National Science Foundation
Zitieren
APA
Cai, J., Meng, Z., Khan, A. S., Li, Z., O’Reilly, J., & Tong, Y. (2023). Probabilistic Attribute Tree Structured Convolutional Neural Networks for Facial Expression Recognition in the Wild. IEEE Transactions on Affective Computing, 14(3), 1927-1941. https://doi.org/10.1109/taffc.2022.3156920
Vancouver
Cai J, Meng Z, Khan AS, Li Z, O’Reilly J, Tong Y. Probabilistic Attribute Tree Structured Convolutional Neural Networks for Facial Expression Recognition in the Wild. IEEE Transactions on Affective Computing. 2023;14(3):1927-1941. doi:10.1109/taffc.2022.3156920
BibTeX
@article{Cai2023,
author = {Cai, Jie and Meng, Zibo and Khan, Ahmed Shehab and Li, Zhiyuan and O’Reilly, James and Tong, Yan},
title = {Probabilistic Attribute Tree Structured Convolutional Neural Networks for Facial Expression Recognition in the Wild},
journal = {IEEE Transactions on Affective Computing},
year = {2023},
volume = {14},
number = {3},
pages = {1927--1941},
doi = {10.1109/taffc.2022.3156920}
}
EUVIMED