Automated Speech Analysis for Screening and Monitoring Bipolar Depression: Machine Learning Model Development and Interpretation Study
JMIR Medical Informatics · 04.12.2025 · 13 · e79093
DOI: 10.2196/79093 ↗Kurz gefasst
Fachartikel in der Zeitschrift JMIR Medical Informatics, online erschienen am 04.12.2025. Verfasst von Sooyeon Min und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Neuropsychiatry, Seoul National University Hospital, Seoul, Republic of Korea. Hauptthemen laut MEDLINE: Bipolar Disorder, Machine Learning, Speech, Mass Screening. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Depressive episodes in bipolar disorder are frequent, prolonged, and contribute substantially to functional impairment and reduced quality of life. Therefore, early and objective detection of bipolar depression is critical for timely intervention and improved outcomes. Multimodal speech analyses hold promise for capturing psychomotor, cognitive, and affective changes associated with bipolar depression.
Objective
This study aims to develop between- and within-person classifiers to screen for bipolar depression and monitor longitudinal changes to detect depressive recurrence in patients with bipolar disorder. A secondary objective was to compare the predictive performance across speech modalities.
Methods
We collected 304 voice audio recordings obtained during semistructured interviews with 92 patients diagnosed with bipolar disorder over a 1-year period. Depression severity was assessed using the Hamilton Depression Rating Scale. Acoustic features were extracted using the openSMILE toolkit, and linguistic features were extracted using the Linguistic Inquiry and Word Count frameworks following automatic speech recognition and machine translation. Mixed-effects multivariate linear regression evaluated the associations between speech markers and Hamilton Depression Rating Scale scores adjusting for demographic variables, diagnosis, and feature-specific covariates. Extreme gradient boosting and light gradient boosting were used as base learners. We developed a between-person classifier to detect moderate to severe depression and a within-person classifier to detect recurrence. Hyperparameter tuning and 95% CI estimation were performed using a bootstrap bias-corrected cross-validation (k=5) approach combined with a grid search. Feature contributions were interpreted using Shapley additive explanations.
Results
Patients with depression showed reduced energy modulation, prolonged monotony, and more frequent use of words related to death and negative emotions. The between-person classifier combining acoustic and linguistic features detected moderate to severe depression with an area under the curve of 0.76 compared to 0.54 for the demographic model. The within-person classifier based on speech features detected depression recurrence with an area under the curve of 0.70 compared to 0.55 for the demographic model.
Conclusions
Between- and within-person comparisons of speech markers can be leveraged in detecting and monitoring bipolar depression. We demonstrate the feasibility of applying Linguistic Inquiry and Word Count–based psycholinguistic analysis to machine–transcribed and translated speech, supporting the replicability of this approach across languages. Automated multimodal voice analysis can be integrated into digital health platforms, providing a scalable and effective approach for accessing mental health monitoring and care.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Neuropsychiatry, Seoul National University Hospital, Seoul, Republic of Korea.
- Department of Psychiatry and Behavioral Science, College of Medicine, Seoul National University, Seoul, Republic of Korea.
- Department of Psychiatry, Korea University Medical Center, Seoul, Republic of Korea.
- ActionPower Corp., Seoul, Republic of Korea.
ORCID-Profile: Sooyeon Min, Tae-Sung Yeum, Daun Shin, Sang Jin Rhee, Hyunju Lee, Han-Sung Lee, Seongmin Park, Jihwa Lee, Yong Min Ahn
Zitieren
APA
Min, S., Yeum, T. S., Shin, D., Rhee, S. J., Lee, H., Lee, H. S., Park, S., Lee, J., & Ahn, Y. M. (2025). Automated Speech Analysis for Screening and Monitoring Bipolar Depression: Machine Learning Model Development and Interpretation Study. JMIR Medical Informatics, 13, e79093. https://doi.org/10.2196/79093
Vancouver
Min S, Yeum TS, Shin D, Rhee SJ, Lee H, Lee HS, et al. Automated Speech Analysis for Screening and Monitoring Bipolar Depression: Machine Learning Model Development and Interpretation Study. JMIR Medical Informatics. 2025;13:e79093. doi:10.2196/79093
BibTeX
@article{Min2025,
author = {Min, Sooyeon and Yeum, Tae-Sung and Shin, Daun and Rhee, Sang Jin and Lee, Hyunju and Lee, Han-Sung and Park, Seongmin and Lee, Jihwa and Ahn, Yong Min},
title = {Automated Speech Analysis for Screening and Monitoring Bipolar Depression: Machine Learning Model Development and Interpretation Study},
journal = {JMIR Medical Informatics},
year = {2025},
volume = {13},
pages = {e79093},
doi = {10.2196/79093}
}
EUVIMED