DPD (DePression Detection) Net: a deep neural network for multimodal depression detection
Health Information Science and Systems · 12.11.2024 · 12 (1)
DOI: 10.1007/s13755-024-00311-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Health Information Science and Systems, online erschienen am 12.11.2024. Verfasst von Manlu He und 2 weiteren Autor:innen. Beteiligte Einrichtung: Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Niels Bohrweg 1, 2333CA Leiden, Netherlands. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Themen: Depression
Abstract (Originalsprache)
Depression is one of the most prevalent mental conditions which could impair people's productivity and lead to severe consequences. The diagnosis of this disease is complex as it often relies on a physician's subjective interview-based screening. The aim of our work is to propose deep learning models for automatic depression detection by using different data modalities, which could assist in the diagnosis of depression. Current works on automatic depression detection mostly are tested on a single dataset, which might lack robustness, flexibility and scalability. To alleviate this problem, we design a novel Graph Neural Network-enhanced Transformer model named DePressionDetect Net (DPD Net) that leverages textual, audio and visual features and can work under two different application settings: the clinical setting and the social media setting. The model consists of a unimodal encoder module for encoding single modality, a multimodal encoder module for integrating the multimodal information, and a detection module for producing the final prediction. We also propose a model named DePressionDetect-with-EEG Net (DPD-E Net) to incorporate Electroencephalography (EEG) signals and speech data for depression detection. Experiments across four benchmark datasets show that DPD Net and DPD-E Net can outperform the state-of-the-art models on three datasets (i.e., E-DAIC dataset, Twitter depression dataset and MODMA dataset), and achieve competitive performance on the fourth one (i.e., D-vlog dataset). Ablation studies demonstrate the advantages of the proposed modules and the effectiveness of combining diverse modalities for automatic depression detection.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Niels Bohrweg 1, 2333CA Leiden, Netherlands.
ORCID-Profile: Manlu He
Zitieren
APA
He, M., Bakker, E. M., & Lew, M. S. (2024). DPD (DePression Detection) Net: a deep neural network for multimodal depression detection. Health Information Science and Systems, 12(1). https://doi.org/10.1007/s13755-024-00311-9
Vancouver
He M, Bakker EM, Lew MS. DPD (DePression Detection) Net: a deep neural network for multimodal depression detection. Health Information Science and Systems. 2024;12(1). doi:10.1007/s13755-024-00311-9
BibTeX
@article{He2024,
author = {He, Manlu and Bakker, Erwin M and Lew, Michael S},
title = {DPD (DePression Detection) Net: a deep neural network for multimodal depression detection},
journal = {Health Information Science and Systems},
year = {2024},
volume = {12},
number = {1},
doi = {10.1007/s13755-024-00311-9}
}
EUVIMED