Multi-Modal Depression Detection in Interview via Exploring Emotional Distribution Information
IEEE Transactions on Multimedia · 2025 · 27 · 6872-6883
DOI: 10.1109/tmm.2025.3590939 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Multimedia, 2025. Verfasst von Zhiyuan Zhou und 3 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 72 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.
Themen: Depression
Abstract (Originalsprache)
In recent years, automatic depression detection (ADD) technology has been rapidly developed to boost an objective and assistive diagnosis for major depressive disorder (MDD) with the help of artificial intelligence technology and various physiological and psychological data. Despite emotion being an important reflection of mental status and frequently related to depression symptoms, few recent multi-modal ADD methods take emotional information into account. To address the above issue, we propose to explore emotional distribution information in interviews to assist multi-modal ADD model. On one hand, we use large language models (LLMs) to automatically recognize emotion of text data, and re-organize the data guided by the valence attribute of emotion, which facilitates our model being aware of difference in emotion distribution. On the other hand, we design the emotion encoding which enhances the proposed model to consider the emotional distribution information in its decision-making process. Extensive experiments are conducted by comparing with state-of-the-art ADD methods as well as the ablation study on different modules of the proposed method. More importantly, our experimental results can confirm the research findings in the psychology field, where more attention on negative emotion information is demanded in distinguishing different depressive status.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
Zitieren
APA
Zhou, Z., Guo, Y., Hao, S., & Hong, R. (2025). Multi-Modal Depression Detection in Interview via Exploring Emotional Distribution Information. IEEE Transactions on Multimedia, 27, 6872-6883. https://doi.org/10.1109/tmm.2025.3590939
Vancouver
Zhou Z, Guo Y, Hao S, Hong R. Multi-Modal Depression Detection in Interview via Exploring Emotional Distribution Information. IEEE Transactions on Multimedia. 2025;27:6872-6883. doi:10.1109/tmm.2025.3590939
BibTeX
@article{Zhou2025,
author = {Zhou, Zhiyuan and Guo, Yanrong and Hao, Shijie and Hong, Richang},
title = {Multi-Modal Depression Detection in Interview via Exploring Emotional Distribution Information},
journal = {IEEE Transactions on Multimedia},
year = {2025},
volume = {27},
pages = {6872--6883},
doi = {10.1109/tmm.2025.3590939}
}
EUVIMED