Deep learning-based multimodal vocal emotion recognition
International Journal of Information and Communication Technology · 2026 · 27 (69) · 69-91
DOI: 10.1504/ijict.2026.154383 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Information and Communication Technology, 2026. Verfasst von Lei Zhang.
Abstract (Originalsprache)
In the field of intelligent interaction and mental health screening, accurately identifying the emotions in singing is crucial.However, traditional methods rely solely on voice features, which are prone to misjudgement when recognising complex emotions (such as 'sarcastic' or 'mixed emotions').To address this, this paper proposes a multimodal deep learning model that integrates singing and lyrics text, achieving deep collaboration of the two types of information through a cross-modal attention mechanism.Experiments show that the sentiment recognition accuracy of the model proposed in this paper reaches 81.3%, which is significantly higher than that of the model using only voice (accuracy 72.1%) and the early fusion method (accuracy 78.5%).Its comprehensive discrimination ability is also superior to the comparison baseline.This confirms that multimodal fusion can more comprehensively capture emotional cues, providing a reliable solution for achieving more refined human-computer interaction.
Zitieren
APA
Zhang, L. (2026). Deep learning-based multimodal vocal emotion recognition. International Journal of Information and Communication Technology, 27(69), 69-91. https://doi.org/10.1504/ijict.2026.154383
Vancouver
Zhang L. Deep learning-based multimodal vocal emotion recognition. International Journal of Information and Communication Technology. 2026;27(69):69-91. doi:10.1504/ijict.2026.154383
BibTeX
@article{Zhang2026,
author = {Zhang, Lei},
title = {Deep learning-based multimodal vocal emotion recognition},
journal = {International Journal of Information and Communication Technology},
year = {2026},
volume = {27},
number = {69},
pages = {69--91},
doi = {10.1504/ijict.2026.154383}
}
EUVIMED