EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TWNet: a transfer learning-based framework for facial macro- and micro-expression spotting in long videos using hybrid features

Huirong Fang, Bin Chen, Jiayu Zou, Sze Teng Liong, Kunhong Liu

PeerJ Computer Science · 21.04.2026 · 12 · e3663

DOI: 10.7717/peerj-cs.3663 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 21.04.2026. Verfasst von Huirong Fang und 4 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Public Technology Service platform project of Xiamen City.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the field of computer vision, spotting the occurrences of macro-expression (MaE) and micro-expression (ME) intervals from long video sequences is an intriguing topic across various research domains. However, due to the small sample size, only the unsupervised learning methods had been applied to tackle this problem. In this article, transfer learning is introduced, proposing a novel Two-Way neural Network (TWNet) to handle the spotting tasks. TWNet learns hybrid features separately in each way: the optical flow features and the facial features in the apex frame. Each way is trained by the widely used MaE datasets first, then the video sequences are fed to TWNet. TWNet predicts the probability of each frame belonging to the MaE and forms a probability sequence. Then, a self-adaptive peak detection and interval generation algorithm is designed to select the apex frames in the probability sequence. Finally, the frames before and after the detected apex are labeled to generate the final MaE and ME intervals. Experiment results show that our TWNet outperforms the state-of-the-art models for spotting MaE and ME intervals on both the SAMM Long Videos and CAS(ME) 2 datasets.

Förderung

  • Public Technology Service platform project of Xiamen City

Zitieren

APA

Fang, H., Chen, B., Zou, J., Liong, S. T., & Liu, K. (2026). TWNet: a transfer learning-based framework for facial macro- and micro-expression spotting in long videos using hybrid features. PeerJ Computer Science, 12, e3663. https://doi.org/10.7717/peerj-cs.3663

Vancouver

Fang H, Chen B, Zou J, Liong ST, Liu K. TWNet: a transfer learning-based framework for facial macro- and micro-expression spotting in long videos using hybrid features. PeerJ Computer Science. 2026;12:e3663. doi:10.7717/peerj-cs.3663

BibTeX
@article{Fang2026,
  author = {Fang, Huirong and Chen, Bin and Zou, Jiayu and Liong, Sze Teng and Liu, Kunhong},
  title = {TWNet: a transfer learning-based framework for facial macro- and micro-expression spotting in long videos using hybrid features},
  journal = {PeerJ Computer Science},
  year = {2026},
  volume = {12},
  pages = {e3663},
  doi = {10.7717/peerj-cs.3663}
}
Kostenlos starten →