EUVIMEDEUVIMED entdecken
Crossref

Micro-Expression Analysis Based on Self-Adaptive Pseudo-Labeling and Residual Connected Channel Attention Mechanisms

Jinxiu Zhang, Weidong Min, Jiahao Li, Qing Han

IEEE Transactions on Image Processing · 2026

DOI: 10.1109/tip.2025.3642527 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2026. Verfasst von Jinxiu Zhang und 3 weiteren Autor:innen. Hauptthemen laut MEDLINE: Video Recording, Image Processing, Computer-Assisted, Emotions, Facial Expression. Die Arbeit nennt 41 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Jiangxi Provincial Key Laboratory of Virtual Reality.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Micro-expressions can reveal genuine emotions that are not easily concealed, making them invaluable in fields such as psychotherapy and criminal interrogation. However, existing pseudo-labeling-based methods for micro-expression analysis have two major limitations. First, pseudo-labels generated by the sliding window do not account for the actual proportion of micro-expressions in the video, which leads to inaccurate labeling. Second, they predominantly focus on overall features, thereby neglecting subtle features. In this paper, we propose a micro-expression analysis method called Spot-Then-Recognize Method (STRM), which integrates spotting and recognition tasks. To address the first limitation, we propose a Self-Adaptive Pseudo-labeling Method (SAPM) that dynamically assigns pseudo-labels to micro-expression frames according to their actual proportion in the video sequence, thereby improving labeling accuracy. To address second limitation, we design a Multi-Scale Residual Channel Attention Network (MSRCAN) to effectively extract subtle micro-expression features. The MSRCAN comprises three modules: Multi-Scale Shared Network (MSSN), Spotting Network, and Recognition Network. The MSSN initially extracts micro-expression features by performing multi-scale feature extraction with Residual Connected Channel Attention Modules (RCCAM), which are then refined in the spotting and recognition networks. We conducted comprehensive experiments on three short video datasets (CASME II, SMIC-E-HS, SMIC-E-NIR) and two long video datasets (CAS(ME)2, SAMMLV). Experimental results show that our proposed method significantly outperforms existing methods, achieving an overall performance of 58.24%, a 19.62% improvement, and a $1.51\times $ gain over the baseline in terms of micro-expression analysis.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Video RecordingImage Processing, Computer-AssistedEmotionsFacial ExpressionHumansAlgorithmsDatabases, Factual

Förderung

  • National Natural Science Foundation of China
  • Jiangxi Provincial Key Laboratory of Virtual Reality

Zitieren

APA

Zhang, J., Min, W., Li, J., & Han, Q. (2026). Micro-Expression Analysis Based on Self-Adaptive Pseudo-Labeling and Residual Connected Channel Attention Mechanisms. IEEE Transactions on Image Processing. https://doi.org/10.1109/tip.2025.3642527

Vancouver

Zhang J, Min W, Li J, Han Q. Micro-Expression Analysis Based on Self-Adaptive Pseudo-Labeling and Residual Connected Channel Attention Mechanisms. IEEE Transactions on Image Processing. 2026. doi:10.1109/tip.2025.3642527

BibTeX
@article{Zhang2026,
  author = {Zhang, Jinxiu and Min, Weidong and Li, Jiahao and Han, Qing},
  title = {Micro-Expression Analysis Based on Self-Adaptive Pseudo-Labeling and Residual Connected Channel Attention Mechanisms},
  journal = {IEEE Transactions on Image Processing},
  year = {2026},
  doi = {10.1109/tip.2025.3642527}
}
Kostenlos starten →