EUVIMEDEUVIMED entdecken
Open Access

Automated Speech Analysis for Screening and Monitoring Bipolar Depression: Machine Learning Model Development and Interpretation Study

Sooyeon Min iD, Tae-Sung Yeum iD, Daun Shin iD, Sang Jin Rhee iD, Hyunju Lee iD, Han-Sung Lee iD, Seongmin Park iD, Jihwa Lee iD, Yong Min Ahn iD

JMIR Medical Informatics · 04.12.2025 · 13 · e79093

DOI: 10.2196/79093 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR Medical Informatics, online erschienen am 04.12.2025. Verfasst von Sooyeon Min und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Neuropsychiatry, Seoul National University Hospital, Seoul, Republic of Korea. Hauptthemen laut MEDLINE: Bipolar Disorder, Machine Learning, Speech, Mass Screening. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Depressive episodes in bipolar disorder are frequent, prolonged, and contribute substantially to functional impairment and reduced quality of life. Therefore, early and objective detection of bipolar depression is critical for timely intervention and improved outcomes. Multimodal speech analyses hold promise for capturing psychomotor, cognitive, and affective changes associated with bipolar depression.

Objective

This study aims to develop between- and within-person classifiers to screen for bipolar depression and monitor longitudinal changes to detect depressive recurrence in patients with bipolar disorder. A secondary objective was to compare the predictive performance across speech modalities.

Methods

We collected 304 voice audio recordings obtained during semistructured interviews with 92 patients diagnosed with bipolar disorder over a 1-year period. Depression severity was assessed using the Hamilton Depression Rating Scale. Acoustic features were extracted using the openSMILE toolkit, and linguistic features were extracted using the Linguistic Inquiry and Word Count frameworks following automatic speech recognition and machine translation. Mixed-effects multivariate linear regression evaluated the associations between speech markers and Hamilton Depression Rating Scale scores adjusting for demographic variables, diagnosis, and feature-specific covariates. Extreme gradient boosting and light gradient boosting were used as base learners. We developed a between-person classifier to detect moderate to severe depression and a within-person classifier to detect recurrence. Hyperparameter tuning and 95% CI estimation were performed using a bootstrap bias-corrected cross-validation (k=5) approach combined with a grid search. Feature contributions were interpreted using Shapley additive explanations.

Results

Patients with depression showed reduced energy modulation, prolonged monotony, and more frequent use of words related to death and negative emotions. The between-person classifier combining acoustic and linguistic features detected moderate to severe depression with an area under the curve of 0.76 compared to 0.54 for the demographic model. The within-person classifier based on speech features detected depression recurrence with an area under the curve of 0.70 compared to 0.55 for the demographic model.

Conclusions

Between- and within-person comparisons of speech markers can be leveraged in detecting and monitoring bipolar depression. We demonstrate the feasibility of applying Linguistic Inquiry and Word Count–based psycholinguistic analysis to machine–transcribed and translated speech, supporting the replicability of this approach across languages. Automated multimodal voice analysis can be integrated into digital health platforms, providing a scalable and effective approach for accessing mental health monitoring and care.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Bipolar DisorderMachine LearningSpeechMass ScreeningHumansFemaleMaleAdultMiddle Aged

Stichwörter der Autor:innen

AIartificial intelligencebipolar disorderdepressionnatural language processingspeech modalitiesvoice analysis

Autor:innen und Institutionen

  • Department of Neuropsychiatry, Seoul National University Hospital, Seoul, Republic of Korea.
  • Department of Psychiatry and Behavioral Science, College of Medicine, Seoul National University, Seoul, Republic of Korea.
  • Department of Psychiatry, Korea University Medical Center, Seoul, Republic of Korea.
  • ActionPower Corp., Seoul, Republic of Korea.

ORCID-Profile: Sooyeon Min, Tae-Sung Yeum, Daun Shin, Sang Jin Rhee, Hyunju Lee, Han-Sung Lee, Seongmin Park, Jihwa Lee, Yong Min Ahn

Zitieren

APA

Min, S., Yeum, T. S., Shin, D., Rhee, S. J., Lee, H., Lee, H. S., Park, S., Lee, J., & Ahn, Y. M. (2025). Automated Speech Analysis for Screening and Monitoring Bipolar Depression: Machine Learning Model Development and Interpretation Study. JMIR Medical Informatics, 13, e79093. https://doi.org/10.2196/79093

Vancouver

Min S, Yeum TS, Shin D, Rhee SJ, Lee H, Lee HS, et al. Automated Speech Analysis for Screening and Monitoring Bipolar Depression: Machine Learning Model Development and Interpretation Study. JMIR Medical Informatics. 2025;13:e79093. doi:10.2196/79093

BibTeX
@article{Min2025,
  author = {Min, Sooyeon and Yeum, Tae-Sung and Shin, Daun and Rhee, Sang Jin and Lee, Hyunju and Lee, Han-Sung and Park, Seongmin and Lee, Jihwa and Ahn, Yong Min},
  title = {Automated Speech Analysis for Screening and Monitoring Bipolar Depression: Machine Learning Model Development and Interpretation Study},
  journal = {JMIR Medical Informatics},
  year = {2025},
  volume = {13},
  pages = {e79093},
  doi = {10.2196/79093}
}
Infokarte | EUVIMED

Artikeldaten derzeit nicht verfügbar.

Recherche