EUVIMEDEUVIMED entdecken
Crossref

MLlm-DR: Towards Explainable Depression Recognition with MultiModal Large Language Models

Wei Zhang, Juan Chen, En Zhu, Wenhong Cheng, Yunpeng Li, Yuhan Li, Yanbo J Wang

ACM Transactions on Multimedia Computing, Communications, and Applications · 30.04.2026 · 22 (4) · 1-23

DOI: 10.1145/3796722 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 23.03.2026. Verfasst von Wei Zhang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 59 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Clinical depression diagnosis relies heavily on both verbal and non-verbal cues in patient interviews, yet existing automated methods often operate as black-box models and fail to provide trustworthy explanations, limiting their clinical applicability. Moreover, depression datasets commonly impose strict privacy constraints that prohibit access to raw audio–visual data, and the deployment of large LLMs in real-world medical environments is often constrained by computational cost limitations. To address these challenges, we propose MLlm-DR, a multimodal large language model for explainable depression recognition. We first employ knowledge distillation to transfer high-quality diagnostic rationales from a powerful LLMs to a smaller, deployable LLMs, thereby equipping it with clinically aligned reasoning abilities. We further introduce a lightweight query module (LQ-former) that extracts salient depression-related cues from pre-extracted audio and visual features and maps them into an LLM-compatible representation. MLlm-DR is trained in two stages: multimodal alignment via LQ-former pretraining, followed by multi-task optimization that jointly learns rationale generation and score regression, encouraging consistency and improving interpretability. Experimental results show that MLlm-DR achieves state-of-the-art performance on two interview-based benchmark datasets, CMDC and E-DAIC-WOZ, while simultaneously generating clinically meaningful and readable explanations.

Zitieren

APA

Zhang, W., Chen, J., Zhu, E., Cheng, W., Li, Y., Li, Y., & Wang, Y. J. (2026). MLlm-DR: Towards Explainable Depression Recognition with MultiModal Large Language Models. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(4), 1-23. https://doi.org/10.1145/3796722

Vancouver

Zhang W, Chen J, Zhu E, Cheng W, Li Y, Li Y, et al. MLlm-DR: Towards Explainable Depression Recognition with MultiModal Large Language Models. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(4):1-23. doi:10.1145/3796722

BibTeX
@article{Zhang2026,
  author = {Zhang, Wei and Chen, Juan and Zhu, En and Cheng, Wenhong and Li, Yunpeng and Li, Yuhan and Wang, Yanbo J},
  title = {MLlm-DR: Towards Explainable Depression Recognition with MultiModal Large Language Models},
  journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
  year = {2026},
  volume = {22},
  number = {4},
  pages = {1--23},
  doi = {10.1145/3796722}
}
Kostenlos starten →