EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal Data Fusion for Depression Detection Approach

Mariia Nykoniuk, Oleh Basystiuk, Nataliya Shakhovska, Nataliia Melnykova

Computation · 02.01.2025 · 13 (1) · 9

DOI: 10.3390/computation13010009 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computation, online erschienen am 02.01.2025. Verfasst von Mariia Nykoniuk und 3 weiteren Autor:innen. Die Arbeit wurde bisher 51-mal zitiert (Crossref) und nennt 15 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Depression is one of the most common mental health disorders in the world, affecting millions of people. Early detection of depression is crucial for effective medical intervention. Multimodal networks can greatly assist in the detection of depression, especially in situations where in patients are not always aware of or able to express their symptoms. By analyzing text and audio data, such networks are able to automatically identify patterns in speech and behavior that indicate a depressive state. In this study, we propose two multimodal information fusion networks: early and late fusion. These networks were developed using convolutional neural network (CNN) layers to learn local patterns, a bidirectional LSTM (Bi-LSTM) to process sequences, and a self-attention mechanism to improve focus on key parts of the data. The DAIC-WOZ and EDAIC-WOZ datasets were used for the experiments. The experiments compared the precision, recall, f1-score, and accuracy metrics for the cases of using early and late multimodal data fusion and found that the early information fusion multimodal network achieved higher classification accuracy results. On the test dataset, this network achieved an f1-score of 0.79 and an overall classification accuracy of 0.86, indicating its effectiveness in detecting depression.

Zitieren

APA

Nykoniuk, M., Basystiuk, O., Shakhovska, N., & Melnykova, N. (2025). Multimodal Data Fusion for Depression Detection Approach. Computation, 13(1), 9. https://doi.org/10.3390/computation13010009

Vancouver

Nykoniuk M, Basystiuk O, Shakhovska N, Melnykova N. Multimodal Data Fusion for Depression Detection Approach. Computation. 2025;13(1):9. doi:10.3390/computation13010009

BibTeX
@article{Nykoniuk2025,
  author = {Nykoniuk, Mariia and Basystiuk, Oleh and Shakhovska, Nataliya and Melnykova, Nataliia},
  title = {Multimodal Data Fusion for Depression Detection Approach},
  journal = {Computation},
  year = {2025},
  volume = {13},
  number = {1},
  pages = {9},
  doi = {10.3390/computation13010009}
}
Kostenlos starten →