EUVIMEDEUVIMED entdecken
Open Access

Automatic Depression Detection Using Smartphone-Based Text-Dependent Speech Signals: Deep Convolutional Neural Network Approach

Ah Young Kim iD, Eun Hye Jang iD, Seung-Hwan Lee iD, Kwang-Yeon Choi iD, Jeon Gue Park iD, Hyun-Chool Shin iD

Journal of Medical Internet Research · 25.01.2023 · 25 · e34474

DOI: 10.2196/34474 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Medical Internet Research, online erschienen am 25.01.2023. Verfasst von Ah Young Kim und 5 weiteren Autor:innen. Beteiligte Einrichtung: Medical Information Research Section, Electronics and Telecommunications Research Institute, Dajeon, Republic of Korea. Hauptthemen laut MEDLINE: Speech, Major Depressive Disorder. Die Arbeit wurde bisher 96-mal zitiert (Crossref) und nennt 63 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Automatic diagnosis of depression based on speech can complement mental health treatment methods in the future. Previous studies have reported that acoustic properties can be used to identify depression. However, few studies have attempted a large-scale differential diagnosis of patients with depressive disorders using acoustic characteristics of non-English speakers.

Objective

This study proposes a framework for automatic depression detection using large-scale acoustic characteristics based on the Korean language.

Methods

We recruited 153 patients who met the criteria for major depressive disorder and 165 healthy controls without current or past mental illness. Participants' voices were recorded on a smartphone while performing the task of reading predefined text-based sentences. Three approaches were evaluated and compared to detect depression using data sets with text-dependent read speech tasks: conventional machine learning models based on acoustic features, a proposed model that trains and classifies log-Mel spectrograms by applying a deep convolutional neural network (CNN) with a relatively small number of parameters, and models that train and classify log-Mel spectrograms by applying well-known pretrained networks.

Results

The acoustic characteristics of the predefined text-based sentence reading automatically detected depression using the proposed CNN model. The highest accuracy achieved with the proposed CNN on the speech data was 78.14%. Our results show that the deep-learned acoustic characteristics lead to better performance than those obtained using the conventional approach and pretrained models.

Conclusions

Checking the mood of patients with major depressive disorder and detecting the consistency of objective descriptions are very important research topics. This study suggests that the analysis of speech data recorded while reading text-dependent sentences could help predict depression status automatically by capturing the characteristics of depression. Our method is smartphone based, is easily accessible, and can contribute to the automatic identification of depressive states.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SpeechMajor Depressive DisorderHumansDepressionSmartphoneNeural Networks, Computer

Stichwörter der Autor:innen

ADDMDDacousticautomatic depression detectiondeep learningdepressionmajor depressive disordermobile healthmobile phonesmartphonespeech analysis

Autor:innen und Institutionen

  • Medical Information Research Section, Electronics and Telecommunications Research Institute, Dajeon, Republic of Korea.
  • Clinical Emotion and Cognition Research Laboratory, Inje University, Goyang, Republic of Korea.
  • Department of Psychiatry, Inje University, Ilsan-Paik Hospital, Goyang, Republic of Korea.
  • Bwave Inc, Goyang, Republic of Korea.
  • Department of Psychiatry, College of Medicine, Chungnam National University, Daejeon, Republic of Korea.
  • Artificial Intelligence Research Laboratory, Electronics and Telecommunications Research Institute, Dajeon, Republic of Korea.

ORCID-Profile: Ah Young Kim, Eun Hye Jang, Seung-Hwan Lee, Kwang-Yeon Choi, Jeon Gue Park, Hyun-Chool Shin

Zitieren

APA

Kim, A. Y., Jang, E. H., Lee, S. H., Choi, K. Y., Park, J. G., & Shin, H. C. (2023). Automatic Depression Detection Using Smartphone-Based Text-Dependent Speech Signals: Deep Convolutional Neural Network Approach. Journal of Medical Internet Research, 25, e34474. https://doi.org/10.2196/34474

Vancouver

Kim AY, Jang EH, Lee SH, Choi KY, Park JG, Shin HC. Automatic Depression Detection Using Smartphone-Based Text-Dependent Speech Signals: Deep Convolutional Neural Network Approach. Journal of Medical Internet Research. 2023;25:e34474. doi:10.2196/34474

BibTeX
@article{Kim2023,
  author = {Kim, Ah Young and Jang, Eun Hye and Lee, Seung-Hwan and Choi, Kwang-Yeon and Park, Jeon Gue and Shin, Hyun-Chool},
  title = {Automatic Depression Detection Using Smartphone-Based Text-Dependent Speech Signals: Deep Convolutional Neural Network Approach},
  journal = {Journal of Medical Internet Research},
  year = {2023},
  volume = {25},
  pages = {e34474},
  doi = {10.2196/34474}
}
Kostenlos starten →