EUVIMEDAvasta EUVIMED
Open access

Psychosocial Stress in the Chinese Community: Speech Analytics Through Linguistic and Acoustic Fusion Using Machine Learning

Amanda M Y Chu, Benson S Y Lam, Jenny T Y Tsang, Agnes Tiwari, Jacky N L Chan, Mike K P So

JMIR Biomedical Engineering · 2026-05-29 · 11 · e91138-e91138

DOI: 10.2196/91138 ↗

At a glance

Journal article in JMIR Biomedical Engineering, published online on 2026-05-29. Written by Amanda M Y Chu and 5 co-authors. Institution: Department of Social Sciences and Policy Studies, The Education University of Hong Kong, Tai Po, Hong Kong, China. 41 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliograafilised andmedCiteRelated studies

Abstract (original language)

Background

Family caregivers experience significant stress due to intensive caregiving activities, making them highly susceptible to adverse psychosocial health conditions. Early detection of this stress is crucial for timely interventions to prevent disease progression and long-term disability.

Objective

This study aimed to develop and validate the Linguistic and Acoustic Speech Analytics Program, a novel machine learning approach capable of providing a fusion analysis of linguistic and acoustic speech features to enhance the effectiveness of psychosocial stress assessment.

Methods

This quantitative study analyzed speech data collected from 100 Chinese family caregivers. Participants responded to 12 open-ended questions, and their voices were recorded for linguistic and acoustic feature extraction. Various machine learning classifiers, including support vector machine, were developed to process speech data. A key methodological step was the application of an orthogonalization procedure to decorrelate acoustic features from linguistic features before fusion analysis. The classifiers were then trained to evaluate psychosocial stress levels based on the processed and fused linguistic and acoustic speech features. Model performance was measured using receiver operating characteristic-area under the curve, F 1 -score, and accuracy.

Results

The linear support vector machine model emerged as the top performer, achieving a receiver operating characteristic-area under the curve of 78.28%, an F 1 -score of 75.27%, and an accuracy of 73%. These results demonstrate the model’s strong capability in identifying stressed participants based on their speech. Critically, the fusion of linguistic and acoustic features significantly outperformed models using either feature type alone. Furthermore, the orthogonalization procedure proved essential, as decorrelating features before fusion markedly enhanced classification accuracy compared to using non-orthogonalized features.

Conclusions

This study demonstrates that fusion analysis of linguistic and acoustic features effectively identifies psychosocial stress among family caregivers. It also emphasizes the importance of proper feature processing when combining multiple features extracted from the same audio sample. These findings provide valuable insights for developing machine learning models for psychosocial stress assessment and addressing various psychosocial conditions in different contexts, supporting population mental health management.

Subjects

Author keywords

caregiversdigital healthpsychosocial healthspeech analyticstext analytics

Authors and institutions

  • Department of Social Sciences and Policy Studies, The Education University of Hong Kong, Tai Po, Hong Kong, China.
  • Department of Mathematics, Statistics and Insurance, The Hang Seng University of Hong Kong, Shatin, Hong Kong, China.
  • School of Nursing, Tung Wah College, Homantin, Hong Kong, China.
  • School of Nursing, Hong Kong Sanatorium and Hospital, Hong Kong, China.
  • Department of Information Systems, Business Statistics and Operations Management, The Hong Kong University of Science and Technology, Clear Water Bay, Hong Kong, China, 852 2358 7726.

Cite

APA

Chu, A. M. Y., Lam, B. S. Y., Tsang, J. T. Y., Tiwari, A., Chan, J. N. L., & So, M. K. P. (2026). Psychosocial Stress in the Chinese Community: Speech Analytics Through Linguistic and Acoustic Fusion Using Machine Learning. JMIR Biomedical Engineering, 11, e91138-e91138. https://doi.org/10.2196/91138

Vancouver

Chu AMY, Lam BSY, Tsang JTY, Tiwari A, Chan JNL, So MKP. Psychosocial Stress in the Chinese Community: Speech Analytics Through Linguistic and Acoustic Fusion Using Machine Learning. JMIR Biomedical Engineering. 2026;11:e91138-e91138. doi:10.2196/91138

BibTeX
@article{Chu2026,
  author = {Chu, Amanda M Y and Lam, Benson S Y and Tsang, Jenny T Y and Tiwari, Agnes and Chan, Jacky N L and So, Mike K P},
  title = {Psychosocial Stress in the Chinese Community: Speech Analytics Through Linguistic and Acoustic Fusion Using Machine Learning},
  journal = {JMIR Biomedical Engineering},
  year = {2026},
  volume = {11},
  pages = {e91138--e91138},
  doi = {10.2196/91138}
}
Start for free →