An approach to detect depression through sentiment analysis of speech and facial expressions
Bulletin of Electrical Engineering and Informatics · 01.12.2026 · 15 (6) · 5003-5011
DOI: 10.11591/eei.v15i6.11413 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bulletin of Electrical Engineering and Informatics, online erschienen am 01.12.2026. Verfasst von Uma Yadav und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Themen: Depression
Abstract (Originalsprache)
Depression is one of the most common mental illnesses among all people, and the early detection of such disease is very hard due to subjective way of detection in classical methods. Audiovisual clues can be used as a source for the detection of depressive symptomatology due to the fact that they are not subjectively estimated. This paper presents the multimodal system for the automatic detection of depressive symptomatology based on audiovisual data analysis. The suggested method includes the following stages: preprocessing, audiovisual feature extraction, dimensionality reduction using factor analysis, multimodal fusion and classification using convolutional neural network (CNN) and deep belief network (DBN). Two different types of multimodal fusion techniques, namely feature level blend and verdict level blend. The accuracy of the suggested methods was measured in order to investigate the efficiency of the combination of audiovisual data. The results show that feature level blend achieves accuracies of 86.4% and 85.1% with CNN and DBN, respectively, and verdict level blend achieves higher accuracies of 88.2% and 87.6%.
Zitieren
APA
Yadav, U., (Maidamwar), P. D., & Bondre, S. V. (2026). An approach to detect depression through sentiment analysis of speech and facial expressions. Bulletin of Electrical Engineering and Informatics, 15(6), 5003-5011. https://doi.org/10.11591/eei.v15i6.11413
Vancouver
Yadav U, (Maidamwar) PD, Bondre SV. An approach to detect depression through sentiment analysis of speech and facial expressions. Bulletin of Electrical Engineering and Informatics. 2026;15(6):5003-5011. doi:10.11591/eei.v15i6.11413
BibTeX
@article{Yadav2026,
author = {Yadav, Uma and (Maidamwar), Priya Dasarwar and Bondre, Shweta V.},
title = {An approach to detect depression through sentiment analysis of speech and facial expressions},
journal = {Bulletin of Electrical Engineering and Informatics},
year = {2026},
volume = {15},
number = {6},
pages = {5003--5011},
doi = {10.11591/eei.v15i6.11413}
}
EUVIMED