EUVIMEDOpdag EUVIMED
Systematische ÜbersichtOpen access

Speech Emotion Recognition in Mental Health: Systematic Review of Voice-Based Applications

Eric Jordan iD, Raphaël Terrisse iD, Valeria Lucarini iD, Motasem Alrahabi iD, Marie-Odile Krebs iD, Julien Desclés iD, Christophe Lemey iD

JMIR Mental Health · 2025-09-30 · 12 · e74260

DOI: 10.2196/74260 ↗

At a glance

Systematische Übersicht in JMIR Mental Health, published online on 2025-09-30. Written by Eric Jordan and 6 co-authors. Institution: ObTIC, Sorbonne Université, Paris, France. Major MEDLINE topics: Emotions, Mental Disorders, Mental Health, Speech. Cited 18 times so far (Crossref); 61 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

The field of speech emotion recognition (SER) encompasses a wide variety of approaches, with artificial intelligence technologies providing improvements in recent years. In the domain of mental health, the links between individuals’ emotional states and pathological diagnoses are of particular interest.

Objective

This study aimed to investigate the performance of tools combining SER and artificial intelligence approaches with a view to their use within clinical contexts and to determine the extent to which SER technologies have already been applied within clinical contexts.

Methods

The review includes studies applied to speech (audio) signals for a select set of pathologies or disorders and only includes those studies that evaluate diagnostic performance using machine learning performance metrics or statistical correlation measures. The PubMed, IEEE Xplore, arXiv, and ScienceDirect databases were queried as recently as February 2025. The Quality Assessment of Diagnostic Accuracy Studies tool was used to measure the risk of bias.

Results

A total of 14 articles were included in the final review. The included papers addressed suicide risk (3/14, 21%), depression (8/14, 57%), and psychotic disorders (3/14, 21%).

Conclusions

SER technologies are mostly used indirectly in mental health research and in a wide variety of ways, including different architectures, datasets, and pathologies. This diversity makes a direct assessment of the technology challenging. Nonetheless, promising results are obtained in various studies that attempt to diagnose patients based on either indirect or direct results from SER models. These results highlight the potential for this technology to be used within a clinical setting. Future work should focus on how clinicians can use these technologies collaboratively. Trial Registration PROSPERO CRD420251006669; https://www.crd.york.ac.uk/PROSPERO/view/CRD420251006669

Subjects

MeSH terms (MEDLINE)

EmotionsMental DisordersMental HealthSpeechHumansArtificial Intelligence

Author keywords

affective computingmachine learningmental healthpsychiatrypsychologyspeech emotion recognitionvoice

Authors and institutions

  • ObTIC, Sorbonne Université, Paris, France.
  • URCI Mental Health Department, Brest Medical University Hospital, Brest, France.
  • EA 7479 SPURBO, Université de Bretagne Occidentale, Brest, France.
  • Université Paris Cité, Institute of Psychiatry and Neuroscience of Paris (IPNP), INSERM U1266, team "Pathophysiology of Psychiatric disorders :Development and Vulnerability", Paris, France.
  • GHU-Paris Psychiatrie et Neurosciences, Hôpital Sainte Anne, Evaluation, Prevention and Therapeutic Innovation Department, F-75014, Paris, France.
  • IMT Atlantique, Lab-STICC, UMR CNRS 6285, F-29238, Brest, France.

ORCID profiles: Eric Jordan, Raphaël Terrisse, Valeria Lucarini, Motasem Alrahabi, Marie-Odile Krebs, Julien Desclés, Christophe Lemey

Cite

APA

Jordan, E., Terrisse, R., Lucarini, V., Alrahabi, M., Krebs, M. O., Desclés, J., & Lemey, C. (2025). Speech Emotion Recognition in Mental Health: Systematic Review of Voice-Based Applications. JMIR Mental Health, 12, e74260. https://doi.org/10.2196/74260

Vancouver

Jordan E, Terrisse R, Lucarini V, Alrahabi M, Krebs MO, Desclés J, et al. Speech Emotion Recognition in Mental Health: Systematic Review of Voice-Based Applications. JMIR Mental Health. 2025;12:e74260. doi:10.2196/74260

BibTeX
@article{Jordan2025,
  author = {Jordan, Eric and Terrisse, Raphaël and Lucarini, Valeria and Alrahabi, Motasem and Krebs, Marie-Odile and Desclés, Julien and Lemey, Christophe},
  title = {Speech Emotion Recognition in Mental Health: Systematic Review of Voice-Based Applications},
  journal = {JMIR Mental Health},
  year = {2025},
  volume = {12},
  pages = {e74260},
  doi = {10.2196/74260}
}
Start for free →