TWNet: a transfer learning-based framework for facial macro- and micro-expression spotting in long videos using hybrid features
PeerJ Computer Science · 21.04.2026 · 12 · e3663
DOI: 10.7717/peerj-cs.3663 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 21.04.2026. Verfasst von Huirong Fang und 4 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Public Technology Service platform project of Xiamen City.
Abstract (Originalsprache)
In the field of computer vision, spotting the occurrences of macro-expression (MaE) and micro-expression (ME) intervals from long video sequences is an intriguing topic across various research domains. However, due to the small sample size, only the unsupervised learning methods had been applied to tackle this problem. In this article, transfer learning is introduced, proposing a novel Two-Way neural Network (TWNet) to handle the spotting tasks. TWNet learns hybrid features separately in each way: the optical flow features and the facial features in the apex frame. Each way is trained by the widely used MaE datasets first, then the video sequences are fed to TWNet. TWNet predicts the probability of each frame belonging to the MaE and forms a probability sequence. Then, a self-adaptive peak detection and interval generation algorithm is designed to select the apex frames in the probability sequence. Finally, the frames before and after the detected apex are labeled to generate the final MaE and ME intervals. Experiment results show that our TWNet outperforms the state-of-the-art models for spotting MaE and ME intervals on both the SAMM Long Videos and CAS(ME) 2 datasets.
Förderung
- Public Technology Service platform project of Xiamen City
Zitieren
APA
Fang, H., Chen, B., Zou, J., Liong, S. T., & Liu, K. (2026). TWNet: a transfer learning-based framework for facial macro- and micro-expression spotting in long videos using hybrid features. PeerJ Computer Science, 12, e3663. https://doi.org/10.7717/peerj-cs.3663
Vancouver
Fang H, Chen B, Zou J, Liong ST, Liu K. TWNet: a transfer learning-based framework for facial macro- and micro-expression spotting in long videos using hybrid features. PeerJ Computer Science. 2026;12:e3663. doi:10.7717/peerj-cs.3663
BibTeX
@article{Fang2026,
author = {Fang, Huirong and Chen, Bin and Zou, Jiayu and Liong, Sze Teng and Liu, Kunhong},
title = {TWNet: a transfer learning-based framework for facial macro- and micro-expression spotting in long videos using hybrid features},
journal = {PeerJ Computer Science},
year = {2026},
volume = {12},
pages = {e3663},
doi = {10.7717/peerj-cs.3663}
}
EUVIMED