EUVIMEDEUVIMED entdecken
Open Access

DPD (DePression Detection) Net: a deep neural network for multimodal depression detection

Manlu He iD, Erwin M Bakker, Michael S Lew

Health Information Science and Systems · 12.11.2024 · 12 (1)

DOI: 10.1007/s13755-024-00311-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Health Information Science and Systems, online erschienen am 12.11.2024. Verfasst von Manlu He und 2 weiteren Autor:innen. Beteiligte Einrichtung: Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Niels Bohrweg 1, 2333CA Leiden, Netherlands. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Depression is one of the most prevalent mental conditions which could impair people's productivity and lead to severe consequences. The diagnosis of this disease is complex as it often relies on a physician's subjective interview-based screening. The aim of our work is to propose deep learning models for automatic depression detection by using different data modalities, which could assist in the diagnosis of depression. Current works on automatic depression detection mostly are tested on a single dataset, which might lack robustness, flexibility and scalability. To alleviate this problem, we design a novel Graph Neural Network-enhanced Transformer model named DePressionDetect Net (DPD Net) that leverages textual, audio and visual features and can work under two different application settings: the clinical setting and the social media setting. The model consists of a unimodal encoder module for encoding single modality, a multimodal encoder module for integrating the multimodal information, and a detection module for producing the final prediction. We also propose a model named DePressionDetect-with-EEG Net (DPD-E Net) to incorporate Electroencephalography (EEG) signals and speech data for depression detection. Experiments across four benchmark datasets show that DPD Net and DPD-E Net can outperform the state-of-the-art models on three datasets (i.e., E-DAIC dataset, Twitter depression dataset and MODMA dataset), and achieve competitive performance on the fourth one (i.e., D-vlog dataset). Ablation studies demonstrate the advantages of the proposed modules and the effectiveness of combining diverse modalities for automatic depression detection.

Schlagwörter

Stichwörter der Autor:innen

Deep neural networkDepression detectionEnsemble modelGraph neural networksMultimodal dataTransformers

Autor:innen und Institutionen

  • Leiden Institute of Advanced Computer Science (LIACS), Leiden University, Niels Bohrweg 1, 2333CA Leiden, Netherlands.

ORCID-Profile: Manlu He

Zitieren

APA

He, M., Bakker, E. M., & Lew, M. S. (2024). DPD (DePression Detection) Net: a deep neural network for multimodal depression detection. Health Information Science and Systems, 12(1). https://doi.org/10.1007/s13755-024-00311-9

Vancouver

He M, Bakker EM, Lew MS. DPD (DePression Detection) Net: a deep neural network for multimodal depression detection. Health Information Science and Systems. 2024;12(1). doi:10.1007/s13755-024-00311-9

BibTeX
@article{He2024,
  author = {He, Manlu and Bakker, Erwin M and Lew, Michael S},
  title = {DPD (DePression Detection) Net: a deep neural network for multimodal depression detection},
  journal = {Health Information Science and Systems},
  year = {2024},
  volume = {12},
  number = {1},
  doi = {10.1007/s13755-024-00311-9}
}
Kostenlos starten →