Speech Emotion Recognition Using Multi-Scale Global–Local Representation Learning with Feature Pyramid Network
Applied Sciences · 10.12.2024 · 14 (24) · 11494
DOI: 10.3390/app142411494 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 10.12.2024. Verfasst von Yuhua Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Speech emotion recognition (SER) is important in facilitating natural human–computer interactions. In speech sequence modeling, a vital challenge is to learn context-aware sentence expression and temporal dynamics of paralinguistic features to achieve unambiguous emotional semantic understanding. In previous studies, the SER method based on the single-scale cascade feature extraction module could not effectively preserve the temporal structure of speech signals in the deep layer, downgrading the sequence modeling performance. To address these challenges, this paper proposes a novel multi-scale feature pyramid network. The enhanced multi-scale convolutional neural networks (MSCNNs) significantly improve the ability to extract multi-granular emotional features. Experimental results on the IEMOCAP corpus demonstrate the effectiveness of the proposed approach, achieving a weighted accuracy (WA) of 71.79% and an unweighted accuracy (UA) of 73.39%. Furthermore, on the RAVDESS dataset, the model achieves an unweighted accuracy (UA) of 86.5%. These results validate the system’s performance and highlight its competitive advantage.
Zitieren
APA
Wang, Y., Huang, J., Zhao, Z., Lan, H., & Zhang, X. (2024). Speech Emotion Recognition Using Multi-Scale Global–Local Representation Learning with Feature Pyramid Network. Applied Sciences, 14(24), 11494. https://doi.org/10.3390/app142411494
Vancouver
Wang Y, Huang J, Zhao Z, Lan H, Zhang X. Speech Emotion Recognition Using Multi-Scale Global–Local Representation Learning with Feature Pyramid Network. Applied Sciences. 2024;14(24):11494. doi:10.3390/app142411494
BibTeX
@article{Wang2024,
author = {Wang, Yuhua and Huang, Jianxing and Zhao, Zhengdao and Lan, Haiyan and Zhang, Xinjia},
title = {Speech Emotion Recognition Using Multi-Scale Global–Local Representation Learning with Feature Pyramid Network},
journal = {Applied Sciences},
year = {2024},
volume = {14},
number = {24},
pages = {11494},
doi = {10.3390/app142411494}
}
EUVIMED