Meta-MMFNet: Meta-learning-based Multi-model Fusion Network for Micro-expression Recognition
ACM Transactions on Multimedia Computing, Communications, and Applications · 29.02.2024 · 20 (2) · 1-20
DOI: 10.1145/3539576 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 25.09.2023. Verfasst von Wenjuan Gong und 4 weiteren Autor:innen. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 61 Literaturangaben. Gefördert von: Spanish Ministry of Economy and Competitiveness, European Regional Development Fund.
Abstract (Originalsprache)
Despite its wide applications in criminal investigations and clinical communications with patients suffering from autism, automatic micro-expression recognition remains a challenging problem because of the lack of training data and imbalanced classes problems. In this study, we proposed a meta-learning-based multi-model fusion network (Meta-MMFNet) to solve the existing problems. The proposed method is based on the metric-based meta-learning pipeline, which is specifically designed for few-shot learning and is suitable for model-level fusion. The frame difference and optical flow features were fused, deep features were extracted from the fused feature, and finally in the meta-learning-based framework, weighted sum model fusion method was applied for micro-expression classification. Meta-MMFNet achieved better results than state-of-the-art methods on four datasets. The code is available at https://github.com/wenjgong/meta-fusion-based-method .
Förderung
- Spanish Ministry of Economy and Competitiveness
- European Regional Development Fund
Zitieren
APA
Gong, W., Zhang, Y., Wang, W., Cheng, P., & Gonzàlez, J. (2024). Meta-MMFNet: Meta-learning-based Multi-model Fusion Network for Micro-expression Recognition. ACM Transactions on Multimedia Computing, Communications, and Applications, 20(2), 1-20. https://doi.org/10.1145/3539576
Vancouver
Gong W, Zhang Y, Wang W, Cheng P, Gonzàlez J. Meta-MMFNet: Meta-learning-based Multi-model Fusion Network for Micro-expression Recognition. ACM Transactions on Multimedia Computing, Communications, and Applications. 2024;20(2):1-20. doi:10.1145/3539576
BibTeX
@article{Gong2024,
author = {Gong, Wenjuan and Zhang, Yue and Wang, Wei and Cheng, Peng and Gonzàlez, Jordi},
title = {Meta-MMFNet: Meta-learning-based Multi-model Fusion Network for Micro-expression Recognition},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2024},
volume = {20},
number = {2},
pages = {1--20},
doi = {10.1145/3539576}
}
EUVIMED