EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

A lightweight method for face expression recognition based on improved MobileNetV3

Xunru Liang, Jianfeng Liang, Tao Yin, Xiaoyu Tang

IET Image Processing · 2023-06 · 17 (8) · 2375-2384

DOI: 10.1049/ipr2.12798 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 02.04.2023. Verfasst von Xunru Liang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial expression recognition plays a significant role in the application of man–machine interaction. However, existing models typically have shortcomings with numerous parameters, large model sizes, and high computational costs, which are difficult to deploy in resource‐constrained devices. This paper proposes a lightweight network based on improved MobileNetV3 to mitigate these disadvantages. Firstly, we adjust the channels in the high‐level network to reduce the number of parameters and model size, and then, the coordinate attention mechanism is introduced to the network, which enhances the attention of the network with few parameters and low computing cost. Furthermore, a complementary pooling structure is designed to improve the coordinate attention mechanism, which enables it to assist the network in extracting salient features sufficiently. In addition, the network with the joint loss consisting of the softmax loss and centre loss is trained, which can minimize the intra‐class gap and improve the classification performance. Finally, the network is trained and tested on public datasets FERPlus and RAF‐DB, with the best accuracy of 87.5% and 86.6%, respectively. The FLOPs, parameters, and the memory storage size are only 0.19GMac, 1.3 M, and 15.9 MB, respectively, which is lighter than most state‐of‐the‐art networks. Code is available at https://github.com/RIS‐LAB1/FER‐mobilenet .

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Liang, X., Liang, J., Yin, T., & Tang, X. (2023). A lightweight method for face expression recognition based on improved MobileNetV3. IET Image Processing, 17(8), 2375-2384. https://doi.org/10.1049/ipr2.12798

Vancouver

Liang X, Liang J, Yin T, Tang X. A lightweight method for face expression recognition based on improved MobileNetV3. IET Image Processing. 2023;17(8):2375-2384. doi:10.1049/ipr2.12798

BibTeX
@article{Liang2023,
  author = {Liang, Xunru and Liang, Jianfeng and Yin, Tao and Tang, Xiaoyu},
  title = {A lightweight method for face expression recognition based on improved MobileNetV3},
  journal = {IET Image Processing},
  year = {2023},
  volume = {17},
  number = {8},
  pages = {2375--2384},
  doi = {10.1049/ipr2.12798}
}
Kostenlos starten →