EUVIMEDEUVIMED entdecken
Open Access

Psychosocial Stress in the Chinese Community: Speech Analytics Through Linguistic and Acoustic Fusion Using Machine Learning

Amanda M Y Chu, Benson S Y Lam, Jenny T Y Tsang, Agnes Tiwari, Jacky N L Chan, Mike K P So

JMIR Biomedical Engineering · 29.05.2026 · 11 · e91138-e91138

DOI: 10.2196/91138 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR Biomedical Engineering, online erschienen am 29.05.2026. Verfasst von Amanda M Y Chu und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Social Sciences and Policy Studies, The Education University of Hong Kong, Tai Po, Hong Kong, China. Die Arbeit nennt 41 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Family caregivers experience significant stress due to intensive caregiving activities, making them highly susceptible to adverse psychosocial health conditions. Early detection of this stress is crucial for timely interventions to prevent disease progression and long-term disability.

Objective

This study aimed to develop and validate the Linguistic and Acoustic Speech Analytics Program, a novel machine learning approach capable of providing a fusion analysis of linguistic and acoustic speech features to enhance the effectiveness of psychosocial stress assessment.

Methods

This quantitative study analyzed speech data collected from 100 Chinese family caregivers. Participants responded to 12 open-ended questions, and their voices were recorded for linguistic and acoustic feature extraction. Various machine learning classifiers, including support vector machine, were developed to process speech data. A key methodological step was the application of an orthogonalization procedure to decorrelate acoustic features from linguistic features before fusion analysis. The classifiers were then trained to evaluate psychosocial stress levels based on the processed and fused linguistic and acoustic speech features. Model performance was measured using receiver operating characteristic-area under the curve, F 1 -score, and accuracy.

Results

The linear support vector machine model emerged as the top performer, achieving a receiver operating characteristic-area under the curve of 78.28%, an F 1 -score of 75.27%, and an accuracy of 73%. These results demonstrate the model’s strong capability in identifying stressed participants based on their speech. Critically, the fusion of linguistic and acoustic features significantly outperformed models using either feature type alone. Furthermore, the orthogonalization procedure proved essential, as decorrelating features before fusion markedly enhanced classification accuracy compared to using non-orthogonalized features.

Conclusions

This study demonstrates that fusion analysis of linguistic and acoustic features effectively identifies psychosocial stress among family caregivers. It also emphasizes the importance of proper feature processing when combining multiple features extracted from the same audio sample. These findings provide valuable insights for developing machine learning models for psychosocial stress assessment and addressing various psychosocial conditions in different contexts, supporting population mental health management.

Schlagwörter

Stichwörter der Autor:innen

caregiversdigital healthpsychosocial healthspeech analyticstext analytics

Autor:innen und Institutionen

  • Department of Social Sciences and Policy Studies, The Education University of Hong Kong, Tai Po, Hong Kong, China.
  • Department of Mathematics, Statistics and Insurance, The Hang Seng University of Hong Kong, Shatin, Hong Kong, China.
  • School of Nursing, Tung Wah College, Homantin, Hong Kong, China.
  • School of Nursing, Hong Kong Sanatorium and Hospital, Hong Kong, China.
  • Department of Information Systems, Business Statistics and Operations Management, The Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong, China, 852 2358 7726.

Zitieren

APA

Chu, A. M. Y., Lam, B. S. Y., Tsang, J. T. Y., Tiwari, A., Chan, J. N. L., & So, M. K. P. (2026). Psychosocial Stress in the Chinese Community: Speech Analytics Through Linguistic and Acoustic Fusion Using Machine Learning. JMIR Biomedical Engineering, 11, e91138-e91138. https://doi.org/10.2196/91138

Vancouver

Chu AMY, Lam BSY, Tsang JTY, Tiwari A, Chan JNL, So MKP. Psychosocial Stress in the Chinese Community: Speech Analytics Through Linguistic and Acoustic Fusion Using Machine Learning. JMIR Biomedical Engineering. 2026;11:e91138-e91138. doi:10.2196/91138

BibTeX
@article{Chu2026,
  author = {Chu, Amanda M Y and Lam, Benson S Y and Tsang, Jenny T Y and Tiwari, Agnes and Chan, Jacky N L and So, Mike K P},
  title = {Psychosocial Stress in the Chinese Community: Speech Analytics Through Linguistic and Acoustic Fusion Using Machine Learning},
  journal = {JMIR Biomedical Engineering},
  year = {2026},
  volume = {11},
  pages = {e91138--e91138},
  doi = {10.2196/91138}
}
Kostenlos starten →