EUVIMEDEUVIMED entdecken
Crossref

Deep Multi-Modal Network Based Automated Depression Severity Estimation

Md Azher Uddin, Joolekha Bibi Joolee, Kyung-Ah Sohn

IEEE Transactions on Affective Computing · 01.07.2023 · 14 (3) · 2153-2167

DOI: 10.1109/taffc.2022.3179478 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, erschienen am 01.07.2023. Verfasst von Md Azher Uddin und 2 weiteren Autor:innen. Die Arbeit wurde bisher 94-mal zitiert (Crossref) und nennt 69 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Depression is a severe mental illness that impairs a person's capacity to function normally in personal and professional life. The assessment of depression usually requires a comprehensive examination by an expert professional. Recently, machine learning-based automatic depression assessment has received considerable attention for a reliable and efficient depression diagnosis. Various techniques for automated depression detection were developed; however, certain concerns still need to be investigated. In this work, we propose a novel deep multi-modal framework that effectively utilizes facial and verbal cues for an automated depression assessment. Specifically, we first partition the audio and video data into fixed-length segments. Then, these segments are fed into the Spatio-Temporal Networks as input, which captures both spatial and temporal features as well as assigns higher weights to the features that contribute most. In addition, Volume Local Directional Structural Pattern (VLDSP) based dynamic feature descriptor is introduced to extract the facial dynamics by encoding the structural aspects. Afterwards, we employ the Temporal Attentive Pooling (TAP) approach to summarize the segment-level features for audio and video data. Finally, the multi-modal factorized bilinear pooling (MFB) strategy is applied to fuse the multi-modal features effectively. An extensive experimental study reveals that the proposed method outperforms state-of-the-art approaches.

Zitieren

APA

Uddin, M. A., Joolee, J. B., & Sohn, K. (2023). Deep Multi-Modal Network Based Automated Depression Severity Estimation. IEEE Transactions on Affective Computing, 14(3), 2153-2167. https://doi.org/10.1109/taffc.2022.3179478

Vancouver

Uddin MA, Joolee JB, Sohn K. Deep Multi-Modal Network Based Automated Depression Severity Estimation. IEEE Transactions on Affective Computing. 2023;14(3):2153-2167. doi:10.1109/taffc.2022.3179478

BibTeX
@article{Uddin2023,
  author = {Uddin, Md Azher and Joolee, Joolekha Bibi and Sohn, Kyung-Ah},
  title = {Deep Multi-Modal Network Based Automated Depression Severity Estimation},
  journal = {IEEE Transactions on Affective Computing},
  year = {2023},
  volume = {14},
  number = {3},
  pages = {2153--2167},
  doi = {10.1109/taffc.2022.3179478}
}
Kostenlos starten →