EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Depression recognition using a proposed speech chain model fusing speech production and perception features

Minghao Du, Shuang Liu, Tao Wang, Wenquan Zhang, Yufeng Ke, Long Chen, Dong Ming

Journal of Affective Disorders · 2023-02 · 323 · 299-308

DOI: 10.1016/j.jad.2022.11.060 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Affective Disorders, 2023-02. Verfasst von Minghao Du und 6 weiteren Autor:innen. Beteiligte Einrichtung: Tianjin International Joint Research Center for Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Ti…. Hauptthemen laut MEDLINE: Speech, Speech Perception. Die Arbeit wurde bisher 83-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND: Increasing depression patients puts great pressure on clinical diagnosis. Audio-based diagnosis is a helpful auxiliary tool for early mass screening. However, current methods consider only speech perception features, ignoring patients' vocal tract changes, which may partly result in the poor recognition. METHODS: This work proposes a novel machine speech chain model for depression recognition (MSCDR) that can capture text-independent depressive speech representation from the speaker's mouth to the listener's ear to improve recognition performance. In the proposed MSCDR, linear predictive coding (LPC) and Mel-frequency cepstral coefficients (MFCC) features are extracted to describe the processes of speech generation and of speech perception, respectively. Then, a one-dimensional convolutional neural network and a long short-term memory network sequentially capture intra- and inter-segment dynamic depressive features for classification. RESULTS: We tested the MSCDR on two public datasets with different languages and paradigms, namely, the Distress Analysis Interview Corpus-Wizard of Oz and the Multi-modal Open Dataset for Mental-disorder Analysis. The accuracy of the MSCDR on the two datasets was 0.77 and 0.86, and the average F1 score was 0.75 and 0.86, which were better than the other existing methods. This improvement reveals the complementarity of speech production and perception features in carrying depressive information. LIMITATIONS: The sample size was relatively small, which may limit the application in clinical translation to some extent. CONCLUSION: This experiment proves the good generalization ability and superiority of the proposed MSCDR and suggests that the vocal tract changes in patients with depression deserve attention for audio-based depression diagnosis.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SpeechSpeech PerceptionHumansDepressionRecognition, PsychologyNeural Networks, Computer

Stichwörter der Autor:innen

AudioAuxiliary diagnosisDeep learningDepressionFeature fusion

Autor:innen und Institutionen

  • Tianjin International Joint Research Center for Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China.
  • Tianjin International Joint Research Center for Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China. Electronic address: shuangliu@tju.edu.cn.
  • Tianjin International Joint Research Center for Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Lab of Neural Engineering & Rehabilitation, Department o…

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Du, M., Liu, S., Wang, T., Zhang, W., Ke, Y., Chen, L., & Ming, D. (2023). Depression recognition using a proposed speech chain model fusing speech production and perception features. Journal of Affective Disorders, 323, 299-308. https://doi.org/10.1016/j.jad.2022.11.060

Vancouver

Du M, Liu S, Wang T, Zhang W, Ke Y, Chen L, et al. Depression recognition using a proposed speech chain model fusing speech production and perception features. Journal of Affective Disorders. 2023;323:299-308. doi:10.1016/j.jad.2022.11.060

BibTeX
@article{Du2023,
  author = {Du, Minghao and Liu, Shuang and Wang, Tao and Zhang, Wenquan and Ke, Yufeng and Chen, Long and Ming, Dong},
  title = {Depression recognition using a proposed speech chain model fusing speech production and perception features},
  journal = {Journal of Affective Disorders},
  year = {2023},
  volume = {323},
  pages = {299--308},
  doi = {10.1016/j.jad.2022.11.060}
}
Kostenlos starten →