MLlm-DR: Towards Explainable Depression Recognition with MultiModal Large Language Models
ACM Transactions on Multimedia Computing, Communications, and Applications · 30.04.2026 · 22 (4) · 1-23
DOI: 10.1145/3796722 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 23.03.2026. Verfasst von Wei Zhang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 59 Literaturangaben.
Themen: Depression
Abstract (Originalsprache)
Clinical depression diagnosis relies heavily on both verbal and non-verbal cues in patient interviews, yet existing automated methods often operate as black-box models and fail to provide trustworthy explanations, limiting their clinical applicability. Moreover, depression datasets commonly impose strict privacy constraints that prohibit access to raw audio–visual data, and the deployment of large LLMs in real-world medical environments is often constrained by computational cost limitations. To address these challenges, we propose MLlm-DR, a multimodal large language model for explainable depression recognition. We first employ knowledge distillation to transfer high-quality diagnostic rationales from a powerful LLMs to a smaller, deployable LLMs, thereby equipping it with clinically aligned reasoning abilities. We further introduce a lightweight query module (LQ-former) that extracts salient depression-related cues from pre-extracted audio and visual features and maps them into an LLM-compatible representation. MLlm-DR is trained in two stages: multimodal alignment via LQ-former pretraining, followed by multi-task optimization that jointly learns rationale generation and score regression, encouraging consistency and improving interpretability. Experimental results show that MLlm-DR achieves state-of-the-art performance on two interview-based benchmark datasets, CMDC and E-DAIC-WOZ, while simultaneously generating clinically meaningful and readable explanations.
Zitieren
APA
Zhang, W., Chen, J., Zhu, E., Cheng, W., Li, Y., Li, Y., & Wang, Y. J. (2026). MLlm-DR: Towards Explainable Depression Recognition with MultiModal Large Language Models. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(4), 1-23. https://doi.org/10.1145/3796722
Vancouver
Zhang W, Chen J, Zhu E, Cheng W, Li Y, Li Y, et al. MLlm-DR: Towards Explainable Depression Recognition with MultiModal Large Language Models. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(4):1-23. doi:10.1145/3796722
BibTeX
@article{Zhang2026,
author = {Zhang, Wei and Chen, Juan and Zhu, En and Cheng, Wenhong and Li, Yunpeng and Li, Yuhan and Wang, Yanbo J},
title = {MLlm-DR: Towards Explainable Depression Recognition with MultiModal Large Language Models},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2026},
volume = {22},
number = {4},
pages = {1--23},
doi = {10.1145/3796722}
}
EUVIMED