Speech Emotion Recognition through Hybrid Features and Convolutional Neural Network
Applied Sciences · 10.04.2023 · 13 (8) · 4750
DOI: 10.3390/app13084750 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 10.04.2023. Verfasst von Ala Saleh Alluhaidan und 4 weiteren Autor:innen. Die Arbeit wurde bisher 115-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia.
Abstract (Originalsprache)
Speech emotion recognition (SER) is the process of predicting human emotions from audio signals using artificial intelligence (AI) techniques. SER technologies have a wide range of applications in areas such as psychology, medicine, education, and entertainment. Extracting relevant features from audio signals is a crucial task in the SER process to correctly identify emotions. Several studies on SER have employed short-time features such as Mel frequency cepstral coefficients (MFCCs), due to their efficiency in capturing the periodic nature of audio signals. However, these features are limited in their ability to correctly identify emotion representations. To solve this issue, this research combined MFCCs and time-domain features (MFCCT) to enhance the performance of SER systems. The proposed hybrid features were given to a convolutional neural network (CNN) to build the SER model. The hybrid MFCCT features together with CNN outperformed both MFCCs and time-domain (t-domain) features on the Emo-DB, SAVEE, and RAVDESS datasets by achieving an accuracy of 97%, 93%, and 92% respectively. Additionally, CNN achieved better performance compared to the machine learning (ML) classifiers that were recently used in SER. The proposed features have the potential to be widely utilized to several types of SER datasets for identifying emotions.
Förderung
- Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia
Zitieren
APA
Alluhaidan, A. S., Saidani, O., Jahangir, R., Nauman, M. A., & Neffati, O. S. (2023). Speech Emotion Recognition through Hybrid Features and Convolutional Neural Network. Applied Sciences, 13(8), 4750. https://doi.org/10.3390/app13084750
Vancouver
Alluhaidan AS, Saidani O, Jahangir R, Nauman MA, Neffati OS. Speech Emotion Recognition through Hybrid Features and Convolutional Neural Network. Applied Sciences. 2023;13(8):4750. doi:10.3390/app13084750
BibTeX
@article{Alluhaidan2023,
author = {Alluhaidan, Ala Saleh and Saidani, Oumaima and Jahangir, Rashid and Nauman, Muhammad Asif and Neffati, Omnia Saidani},
title = {Speech Emotion Recognition through Hybrid Features and Convolutional Neural Network},
journal = {Applied Sciences},
year = {2023},
volume = {13},
number = {8},
pages = {4750},
doi = {10.3390/app13084750}
}
EUVIMED