Depression recognition using a proposed speech chain model fusing speech production and perception features
Journal of Affective Disorders · 2023-02 · 323 · 299-308
DOI: 10.1016/j.jad.2022.11.060 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Affective Disorders, 2023-02. Verfasst von Minghao Du und 6 weiteren Autor:innen. Beteiligte Einrichtung: Tianjin International Joint Research Center for Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Ti…. Hauptthemen laut MEDLINE: Speech, Speech Perception. Die Arbeit wurde bisher 83-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China.
Themen: Depression
Abstract (Originalsprache)
BACKGROUND: Increasing depression patients puts great pressure on clinical diagnosis. Audio-based diagnosis is a helpful auxiliary tool for early mass screening. However, current methods consider only speech perception features, ignoring patients' vocal tract changes, which may partly result in the poor recognition. METHODS: This work proposes a novel machine speech chain model for depression recognition (MSCDR) that can capture text-independent depressive speech representation from the speaker's mouth to the listener's ear to improve recognition performance. In the proposed MSCDR, linear predictive coding (LPC) and Mel-frequency cepstral coefficients (MFCC) features are extracted to describe the processes of speech generation and of speech perception, respectively. Then, a one-dimensional convolutional neural network and a long short-term memory network sequentially capture intra- and inter-segment dynamic depressive features for classification. RESULTS: We tested the MSCDR on two public datasets with different languages and paradigms, namely, the Distress Analysis Interview Corpus-Wizard of Oz and the Multi-modal Open Dataset for Mental-disorder Analysis. The accuracy of the MSCDR on the two datasets was 0.77 and 0.86, and the average F1 score was 0.75 and 0.86, which were better than the other existing methods. This improvement reveals the complementarity of speech production and perception features in carrying depressive information. LIMITATIONS: The sample size was relatively small, which may limit the application in clinical translation to some extent. CONCLUSION: This experiment proves the good generalization ability and superiority of the proposed MSCDR and suggests that the vocal tract changes in patients with depression deserve attention for audio-based depression diagnosis.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Tianjin International Joint Research Center for Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China.
- Tianjin International Joint Research Center for Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China. Electronic address: shuangliu@tju.edu.cn.
- Tianjin International Joint Research Center for Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Lab of Neural Engineering & Rehabilitation, Department o…
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Du, M., Liu, S., Wang, T., Zhang, W., Ke, Y., Chen, L., & Ming, D. (2023). Depression recognition using a proposed speech chain model fusing speech production and perception features. Journal of Affective Disorders, 323, 299-308. https://doi.org/10.1016/j.jad.2022.11.060
Vancouver
Du M, Liu S, Wang T, Zhang W, Ke Y, Chen L, et al. Depression recognition using a proposed speech chain model fusing speech production and perception features. Journal of Affective Disorders. 2023;323:299-308. doi:10.1016/j.jad.2022.11.060
BibTeX
@article{Du2023,
author = {Du, Minghao and Liu, Shuang and Wang, Tao and Zhang, Wenquan and Ke, Yufeng and Chen, Long and Ming, Dong},
title = {Depression recognition using a proposed speech chain model fusing speech production and perception features},
journal = {Journal of Affective Disorders},
year = {2023},
volume = {323},
pages = {299--308},
doi = {10.1016/j.jad.2022.11.060}
}
EUVIMED