Automatic Depression Detection Using Smartphone-Based Text-Dependent Speech Signals: Deep Convolutional Neural Network Approach
Journal of Medical Internet Research · 25.01.2023 · 25 · e34474
DOI: 10.2196/34474 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Medical Internet Research, online erschienen am 25.01.2023. Verfasst von Ah Young Kim und 5 weiteren Autor:innen. Beteiligte Einrichtung: Medical Information Research Section, Electronics and Telecommunications Research Institute, Dajeon, Republic of Korea. Hauptthemen laut MEDLINE: Speech, Major Depressive Disorder. Die Arbeit wurde bisher 96-mal zitiert (Crossref) und nennt 63 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Themen: Depression
Abstract (Originalsprache)
Background
Automatic diagnosis of depression based on speech can complement mental health treatment methods in the future. Previous studies have reported that acoustic properties can be used to identify depression. However, few studies have attempted a large-scale differential diagnosis of patients with depressive disorders using acoustic characteristics of non-English speakers.
Objective
This study proposes a framework for automatic depression detection using large-scale acoustic characteristics based on the Korean language.
Methods
We recruited 153 patients who met the criteria for major depressive disorder and 165 healthy controls without current or past mental illness. Participants' voices were recorded on a smartphone while performing the task of reading predefined text-based sentences. Three approaches were evaluated and compared to detect depression using data sets with text-dependent read speech tasks: conventional machine learning models based on acoustic features, a proposed model that trains and classifies log-Mel spectrograms by applying a deep convolutional neural network (CNN) with a relatively small number of parameters, and models that train and classify log-Mel spectrograms by applying well-known pretrained networks.
Results
The acoustic characteristics of the predefined text-based sentence reading automatically detected depression using the proposed CNN model. The highest accuracy achieved with the proposed CNN on the speech data was 78.14%. Our results show that the deep-learned acoustic characteristics lead to better performance than those obtained using the conventional approach and pretrained models.
Conclusions
Checking the mood of patients with major depressive disorder and detecting the consistency of objective descriptions are very important research topics. This study suggests that the analysis of speech data recorded while reading text-dependent sentences could help predict depression status automatically by capturing the characteristics of depression. Our method is smartphone based, is easily accessible, and can contribute to the automatic identification of depressive states.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Medical Information Research Section, Electronics and Telecommunications Research Institute, Dajeon, Republic of Korea.
- Clinical Emotion and Cognition Research Laboratory, Inje University, Goyang, Republic of Korea.
- Department of Psychiatry, Inje University, Ilsan-Paik Hospital, Goyang, Republic of Korea.
- Bwave Inc, Goyang, Republic of Korea.
- Department of Psychiatry, College of Medicine, Chungnam National University, Daejeon, Republic of Korea.
- Artificial Intelligence Research Laboratory, Electronics and Telecommunications Research Institute, Dajeon, Republic of Korea.
ORCID-Profile: Ah Young Kim, Eun Hye Jang, Seung-Hwan Lee, Kwang-Yeon Choi, Jeon Gue Park, Hyun-Chool Shin
Zitieren
APA
Kim, A. Y., Jang, E. H., Lee, S. H., Choi, K. Y., Park, J. G., & Shin, H. C. (2023). Automatic Depression Detection Using Smartphone-Based Text-Dependent Speech Signals: Deep Convolutional Neural Network Approach. Journal of Medical Internet Research, 25, e34474. https://doi.org/10.2196/34474
Vancouver
Kim AY, Jang EH, Lee SH, Choi KY, Park JG, Shin HC. Automatic Depression Detection Using Smartphone-Based Text-Dependent Speech Signals: Deep Convolutional Neural Network Approach. Journal of Medical Internet Research. 2023;25:e34474. doi:10.2196/34474
BibTeX
@article{Kim2023,
author = {Kim, Ah Young and Jang, Eun Hye and Lee, Seung-Hwan and Choi, Kwang-Yeon and Park, Jeon Gue and Shin, Hyun-Chool},
title = {Automatic Depression Detection Using Smartphone-Based Text-Dependent Speech Signals: Deep Convolutional Neural Network Approach},
journal = {Journal of Medical Internet Research},
year = {2023},
volume = {25},
pages = {e34474},
doi = {10.2196/34474}
}
EUVIMED