EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Facial Expression Recognition Methods in the Wild Based on Fusion Feature of Attention Mechanism and LBP

Jun Liao, Yuanchang Lin, Tengyun Ma, Songxiying He, Xiaofang Liu, Guotian He

Sensors · 22.04.2023 · 23 (9) · 4204

DOI: 10.3390/s23094204 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 22.04.2023. Verfasst von Jun Liao und 5 weiteren Autor:innen. Beteiligte Einrichtung: Chongqing Institute of Green Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China. Hauptthemen laut MEDLINE: Facial Recognition. Die Arbeit wurde bisher 50-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key R&D Program(2018YFB1306601), Chinese Academy of Sciences "Light of the West" Talent Training Introduction Program(2019-90), Cooperation projects between Chongqing universities in Chongqing and institutions affiliated with Chinese Academy of Sciences(HZ2021011).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression methods play a vital role in human–computer interaction and other fields, but there are factors such as occlusion, illumination, and pose changes in wild facial recognition, as well as category imbalances between different datasets, that result in large variations in recognition rates and low accuracy rates for different categories of facial expression datasets. This study introduces RCL-Net, a method of recognizing wild facial expressions that is based on an attention mechanism and LBP feature fusion. The structure consists of two main branches, namely the ResNet-CBAM residual attention branch and the local binary feature (LBP) extraction branch (RCL-Net). First, by merging the residual network and hybrid attention mechanism, the residual attention network is presented to emphasize the local detail feature information of facial expressions; the significant characteristics of facial expressions are retrieved from both channel and spatial dimensions to build the residual attention classification model. Second, we present a locally improved residual network attention model. LBP features are introduced into the facial expression feature extraction stage in order to extract texture information on expression photographs in order to emphasize facial feature information and enhance the recognition accuracy of the model. Lastly, experimental validation is performed using the FER2013, FERPLUS, CK+, and RAF-DB datasets, and the experimental results demonstrate that the proposed method has superior generalization capability and robustness in the laboratory-controlled environment and field environment compared to the most recent experimental methods.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Facial RecognitionHumansResearch DesignEnvironment, ControlledFaceLaboratoriesFacial Expression

Stichwörter der Autor:innen

LBP featuresattention mechanismdeep learningfacial expression recognition

Autor:innen und Institutionen

  • Chongqing Institute of Green Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China.
  • College of Mechanical Engineering, Chongqing University of Technology, Chongqing 400054, China.
  • Chongqing Key Laboratory of Artificial Intelligence and Service Robot Control Technology, Chongqing Institute of Green Intelligent Technology, Chinese Academy of Sciences, Chongqing 400714, China.

Förderung

  • National Key R&D Program(2018YFB1306601)
  • Chinese Academy of Sciences "Light of the West" Talent Training Introduction Program(2019-90)
  • Cooperation projects between Chongqing universities in Chongqing and institutions affiliated with Chinese Academy of Sciences(HZ2021011)
  • Chongqing technology innovation and application development special(cstc2021jscx-cylhX0009)
  • National Key R&D Program
  • Chinese Academy of Sciences “Light of the West” Talent Training Introduction Program
  • Cooperation projects between Chongqing universities
  • Chinese Academy of Sciences

Zitieren

APA

Liao, J., Lin, Y., Ma, T., He, S., Liu, X., & He, G. (2023). Facial Expression Recognition Methods in the Wild Based on Fusion Feature of Attention Mechanism and LBP. Sensors, 23(9), 4204. https://doi.org/10.3390/s23094204

Vancouver

Liao J, Lin Y, Ma T, He S, Liu X, He G. Facial Expression Recognition Methods in the Wild Based on Fusion Feature of Attention Mechanism and LBP. Sensors. 2023;23(9):4204. doi:10.3390/s23094204

BibTeX
@article{Liao2023,
  author = {Liao, Jun and Lin, Yuanchang and Ma, Tengyun and He, Songxiying and Liu, Xiaofang and He, Guotian},
  title = {Facial Expression Recognition Methods in the Wild Based on Fusion Feature of Attention Mechanism and LBP},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {9},
  pages = {4204},
  doi = {10.3390/s23094204}
}
Kostenlos starten →