Intelligent module for recognizing emotions by voice
Advanced Information Technology · 2021
DOI: 10.17721/ait.2021.1.06 ↗Kurz gefasst
Fachartikel in der Zeitschrift Advanced Information Technology, 2021. Verfasst von Oleg Ilarionov und 3 weiteren Autor:innen. Die Arbeit nennt 17 Literaturangaben.
Abstract (Originalsprache)
Speech is the main way of communication for people, and people can receive not only semantic but also emotional information from speech. Recognition of emotions by voice is relevant to areas such as psychological care, security systems development, lie detection, customer relationship analysis, video game development. Because the recognition of emotions by a person is subjective, and therefore inexact and time consuming, there is a need to create software that could solve this problem. The article considers the state of the problem of recognizing human emotions by voice. Modern publications, the approaches used in them, namely models of emotions, data sets, methods of extraction of signs, classifiers are analyzed. It is determined that existing developments have an average accuracy of about 0.75. The general structure of the system of recognition of human emotions by voice is analyzed, the corresponding intellectual module is designed and developed. A Unified Modeling Language (UML) is used to create a component diagram and a class diagram. RAVDESS and TESS datasets were selected as datasets to diversify the training sample. A discrete model of emotions (joy, sadness, anger, disgust, fear, surprise, calm, neutral emotion), MFCC (Mel Frequency Cepstral Coefficients) method for extracting signs, convolutional neural network for classification were used. . The neural network was developed using the TensorFlow and Keras machine learning libraries. The spectrogram and graphs of the audio signal, as well as graphs of accuracy and recognition errors are constructed. As a result of the software implementation of the intelligent module for recognizing emotions by voice, the accuracy of validation has been increased to 0.8.
Zitieren
APA
Ilarionov, O., Astakhov, A., Krasovska, A., & Domanetska, I. (2021). Intelligent module for recognizing emotions by voice. Advanced Information Technology. https://doi.org/10.17721/ait.2021.1.06
Vancouver
Ilarionov O, Astakhov A, Krasovska A, Domanetska I. Intelligent module for recognizing emotions by voice. Advanced Information Technology. 2021. doi:10.17721/ait.2021.1.06
BibTeX
@article{Ilarionov2021,
author = {Ilarionov, Oleg and Astakhov, Anton and Krasovska, Anna and Domanetska, Iryna},
title = {Intelligent module for recognizing emotions by voice},
journal = {Advanced Information Technology},
year = {2021},
doi = {10.17721/ait.2021.1.06}
}
EUVIMED