EUVIMEDEUVIMED entdecken
Crossref

Probabilistic Attribute Tree Structured Convolutional Neural Networks for Facial Expression Recognition in the Wild

Jie Cai, Zibo Meng, Ahmed Shehab Khan, Zhiyuan Li, James O’Reilly, Yan Tong

IEEE Transactions on Affective Computing · 01.07.2023 · 14 (3) · 1927-1941

DOI: 10.1109/taffc.2022.3156920 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, erschienen am 01.07.2023. Verfasst von Jie Cai und 5 weiteren Autor:innen. Die Arbeit wurde bisher 44-mal zitiert (Crossref) und nennt 99 Literaturangaben. Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Very recent work has demonstrated tremendous improvements in facial expression recognition (FER) on laboratory-controlled datasets. However, recognizing facial expressions under in-the-wild conditions still remains challenging, especially on unseen subjects due to high inter-subject variations. In this paper, we propose a novel Probabilistic Attribute Tree Convolutional Neural Network (PAT-CNN) to explicitly deal with large intra-class variations caused by identity-related attributes, e.g., age, race, and gender. Specifically, a PAT module with an associated PAT loss is proposed to learn features in a hierarchical tree structure organized according to identity-related attributes, where the final features are less affected by the attributes. Then, expression-related features are extracted from leaf nodes. Samples are probabilistically assigned to tree nodes at different levels such that expression-related features can be learned from all samples weighted by probabilities. Furthermore, the proposed PAT-CNN can be learned from limited attribute-annotated samples to make the best use of available data. Experimental results on four spontaneous facial expression datasets, i.e., RAF-DB, SFEW, ExpW, and FER-2013, have demonstrated that the proposed PAT-CNN achieves the best performance when compared to state-of-the-art methods by explicitly modeling attributes. Impressively, a single model PAT-CNN achieves the best performance on the SFEW test dataset when compared to the state-of-the-art methods using an ensemble of hundreds of CNNs.

Förderung

  • National Science Foundation

Zitieren

APA

Cai, J., Meng, Z., Khan, A. S., Li, Z., O’Reilly, J., & Tong, Y. (2023). Probabilistic Attribute Tree Structured Convolutional Neural Networks for Facial Expression Recognition in the Wild. IEEE Transactions on Affective Computing, 14(3), 1927-1941. https://doi.org/10.1109/taffc.2022.3156920

Vancouver

Cai J, Meng Z, Khan AS, Li Z, O’Reilly J, Tong Y. Probabilistic Attribute Tree Structured Convolutional Neural Networks for Facial Expression Recognition in the Wild. IEEE Transactions on Affective Computing. 2023;14(3):1927-1941. doi:10.1109/taffc.2022.3156920

BibTeX
@article{Cai2023,
  author = {Cai, Jie and Meng, Zibo and Khan, Ahmed Shehab and Li, Zhiyuan and O’Reilly, James and Tong, Yan},
  title = {Probabilistic Attribute Tree Structured Convolutional Neural Networks for Facial Expression Recognition in the Wild},
  journal = {IEEE Transactions on Affective Computing},
  year = {2023},
  volume = {14},
  number = {3},
  pages = {1927--1941},
  doi = {10.1109/taffc.2022.3156920}
}
Kostenlos starten →