EUVIMEDEUVIMED entdecken
Crossref

Micro-Expression Recognition via Fine-Grained Dynamic Perception

Zhiwen Shao, Yifan Cheng, Fan Zhang, Xuehuai Shi, Canlin Li, Lizhuang Ma, Dit-Yan Yeung

ACM Transactions on Multimedia Computing, Communications, and Applications · 31.10.2025 · 21 (10) · 1-23

DOI: 10.1145/3765901 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 14.10.2025. Verfasst von Zhiwen Shao und 6 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 79 Literaturangaben. Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Hong Kong Scholars Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Facial micro-expression recognition (MER) is a challenging task, due to the transience, subtlety, and dynamics of micro-expressions (MEs). Most existing methods resort to hand-crafted features or deep networks, in which the former often additionally requires key frames, and the latter suffers from small-scale and low-diversity training data. In this article, we develop a novel fine-grained dynamic perception (FDP) framework for MER. We propose to rank frame-level features of a sequence of raw frames in chronological order, in which the rank process encodes the dynamic information of both ME appearances and motions. Specifically, a novel local-global feature-aware transformer is proposed for frame representation learning. A rank scorer is further adopted to calculate rank scores of each frame-level feature. Afterwards, the rank features from rank scorer are pooled in temporal dimension to capture dynamic representation. Finally, the dynamic representation is shared by a MER module and a dynamic image construction module, in which the former predicts the ME category, and the latter uses an encoder-decoder structure to construct the dynamic image. The design of dynamic image construction task is beneficial for capturing facial subtle actions associated with MEs and alleviating the data scarcity issue. Extensive experiments show that our method (i) significantly outperforms the state-of-the-art MER methods, and (ii) works well for dynamic image construction. Particularly, our FDP improves by 4.05%, 2.50%, 7.71%, and 2.11% over the previous best results in terms of F1-score on the CASME II, SAMM, CAS(ME) 2 , and CAS(ME) 3 datasets, respectively. The code is available at https://github.com/CYF-cuber/FDP .

Förderung

  • National Natural Science Foundation of China
  • China Postdoctoral Science Foundation
  • Hong Kong Scholars Program
  • Research Impact Fund of the Hong Kong Government
  • Opening Fund of the State Key Laboratory of Virtual Reality Technology and Systems, Beihang University
  • Science and Technology Planning Project of Henan Province

Zitieren

APA

Shao, Z., Cheng, Y., Zhang, F., Shi, X., Li, C., Ma, L., & Yeung, D. (2025). Micro-Expression Recognition via Fine-Grained Dynamic Perception. ACM Transactions on Multimedia Computing, Communications, and Applications, 21(10), 1-23. https://doi.org/10.1145/3765901

Vancouver

Shao Z, Cheng Y, Zhang F, Shi X, Li C, Ma L, et al. Micro-Expression Recognition via Fine-Grained Dynamic Perception. ACM Transactions on Multimedia Computing, Communications, and Applications. 2025;21(10):1-23. doi:10.1145/3765901

BibTeX
@article{Shao2025,
  author = {Shao, Zhiwen and Cheng, Yifan and Zhang, Fan and Shi, Xuehuai and Li, Canlin and Ma, Lizhuang and Yeung, Dit-Yan},
  title = {Micro-Expression Recognition via Fine-Grained Dynamic Perception},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2025},
  volume = {21},
  number = {10},
  pages = {1--23},
  doi = {10.1145/3765901}
}
Kostenlos starten →