Diagnosis of depression based on facial multimodal data
Frontiers in Psychiatry · 28.01.2025 · 16
DOI: 10.3389/fpsyt.2025.1508772 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Psychiatry, online erschienen am 28.01.2025. Verfasst von Nani Jin und 2 weiteren Autor:innen. Beteiligte Einrichtung: Materdicine Lab, School of Life Sciences, Shanghai University, Shanghai, China. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Themen: Depression
Abstract (Originalsprache)
Introduction
Depression is a serious mental health disease. Traditional scale-based depression diagnosis methods often have problems of strong subjectivity and high misdiagnosis rate, so it is particularly important to develop automatic diagnostic tools based on objective indicators.
Methods
This study proposes a deep learning method that fuses multimodal data to automatically diagnose depression using facial video and audio data. We use spatiotemporal attention module to enhance the extraction of visual features and combine the Graph Convolutional Network (GCN) and the Long and Short Term Memory (LSTM) to analyze the audio features. Through the multi-modal feature fusion, the model can effectively capture different feature patterns related to depression.
Results
We conduct extensive experiments on the publicly available clinical dataset, the Extended Distress Analysis Interview Corpus (E-DAIC). The experimental results show that we achieve robust accuracy on the E-DAIC dataset, with a Mean Absolute Error (MAE) of 3.51 in estimating PHQ-8 scores from recorded interviews.
Discussion
Compared with existing methods, our model shows excellent performance in multi-modal information fusion, which is suitable for early evaluation of depression.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Materdicine Lab, School of Life Sciences, Shanghai University, Shanghai, China.
- Research Department, Third Xiangya Hospital of Central South University, Changsha, China.
Zitieren
APA
Jin, N., Ye, R., & Li, P. (2025). Diagnosis of depression based on facial multimodal data. Frontiers in Psychiatry, 16. https://doi.org/10.3389/fpsyt.2025.1508772
Vancouver
Jin N, Ye R, Li P. Diagnosis of depression based on facial multimodal data. Frontiers in Psychiatry. 2025;16. doi:10.3389/fpsyt.2025.1508772
BibTeX
@article{Jin2025,
author = {Jin, Nani and Ye, Renjia and Li, Peng},
title = {Diagnosis of depression based on facial multimodal data},
journal = {Frontiers in Psychiatry},
year = {2025},
volume = {16},
doi = {10.3389/fpsyt.2025.1508772}
}
EUVIMED