Real-time speech emotion recognition using deep learning and data augmentation
Artificial Intelligence Review · 20.12.2024 · 58 (2)
DOI: 10.1007/s10462-024-11065-x ↗Kurz gefasst
Fachartikel in der Zeitschrift Artificial Intelligence Review, online erschienen am 20.12.2024. Verfasst von Chawki Barhoumi und 1 weiteren Autor:innen. Die Arbeit wurde bisher 76-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
In human-human interactions, detecting emotions is often easy as it can be perceived through facial expressions, body gestures, or speech. However, in human-machine interactions, detecting human emotion can be a challenge. To improve this interaction, the term 'speech emotion recognition' has emerged, with the goal of recognizing emotions solely through vocal intonation. In this work, we propose a speech emotion recognition system based on deep learning approaches and two efficient data augmentation techniques (noise addition and spectrogram shifting). To evaluate the proposed system, we used three different datasets: TESS, EmoDB, and RAVDESS. We employe several algorithms such as Mel Frequency Cepstral Coefficients (MFCC), Zero Crossing Rate (ZCR), Mel spectrograms, Root Mean Square Value (RMS), and chroma to select the most appropriate vocal features that represent speech emotions. To develop our speech emotion recognition system, we use three different deep learning models, including MultiLayer Perceptron (MLP), Convolutional Neural Network (CNN), and a hybrid model that combines CNN with Bidirectional Long-Short Term Memory (Bi-LSTM). By exploring these different approaches, we were able to identify the most effective model for accurately identifying emotional states from speech signals in real-time situation. Overall, our work demonstrates the effectiveness of the proposed deep learning model, specifically based on CNN+BiLSTM, and the used two data augmentation techniques for the proposed real-time speech emotion recognition.
Zitieren
APA
Barhoumi, C., & BenAyed, Y. (2024). Real-time speech emotion recognition using deep learning and data augmentation. Artificial Intelligence Review, 58(2). https://doi.org/10.1007/s10462-024-11065-x
Vancouver
Barhoumi C, BenAyed Y. Real-time speech emotion recognition using deep learning and data augmentation. Artificial Intelligence Review. 2024;58(2). doi:10.1007/s10462-024-11065-x
BibTeX
@article{Barhoumi2024,
author = {Barhoumi, Chawki and BenAyed, Yassine},
title = {Real-time speech emotion recognition using deep learning and data augmentation},
journal = {Artificial Intelligence Review},
year = {2024},
volume = {58},
number = {2},
doi = {10.1007/s10462-024-11065-x}
}
EUVIMED