EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

TheraSense: Deep Learning for Facial Emotion Analysis in Mental Health Teleconsultation

Hayette Hadjar, Binh Vu, Matthias Hemmje

Electronics · 2025-01-22 · 14 (3) · 422

DOI: 10.3390/electronics14030422 ↗

At a glance

Journal article in Electronics, published online on 2025-01-22. Written by Hayette Hadjar and 2 co-authors. Cited 25 times so far (Crossref); 30 references. The full text is freely available (open access, CC BY 4.0).

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

This paper presents TheraSense, a system developed within the Supporting Mental Health in Young People: Integrated Methodology for cLinical dEcisions and evidence (Smile) and Sensor Enabled Affective Computing for Enhancing Medical Care (SenseCare) projects. TheraSense is designed to enhance teleconsultation services by leveraging deep learning for real-time emotion recognition through facial expressions. It integrates with the Knowledge Management-Ecosystem Portal (SenseCare KM-EP) platform to provide mental health practitioners with valuable emotional insights during remote consultations.

Method

We describe the conceptual design of TheraSense, including its use case contexts, architectural structure, and user interface layout. The system’s interoperability is discussed in detail, highlighting its seamless integration within the teleconsultation workflow. The evaluation methods include both quantitative assessments of the video-based emotion recognition system’s performance and qualitative feedback through heuristic evaluation and survey analysis.

Results

The performance evaluation shows that TheraSense effectively recognizes emotions in video streams, with positive user feedback on its usability and integration. The system’s real-time emotion detection capabilities provide valuable support for mental health practitioners during remote sessions.

Conclusions

TheraSense demonstrates its potential as an innovative tool for enhancing teleconsultation services. By providing real-time emotional insights, it supports better-informed decision-making in mental health care, making it an effective addition to remote telehealth platforms.

Cite

APA

Hadjar, H., Vu, B., & Hemmje, M. (2025). TheraSense: Deep Learning for Facial Emotion Analysis in Mental Health Teleconsultation. Electronics, 14(3), 422. https://doi.org/10.3390/electronics14030422

Vancouver

Hadjar H, Vu B, Hemmje M. TheraSense: Deep Learning for Facial Emotion Analysis in Mental Health Teleconsultation. Electronics. 2025;14(3):422. doi:10.3390/electronics14030422

BibTeX
@article{Hadjar2025,
  author = {Hadjar, Hayette and Vu, Binh and Hemmje, Matthias},
  title = {TheraSense: Deep Learning for Facial Emotion Analysis in Mental Health Teleconsultation},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {3},
  pages = {422},
  doi = {10.3390/electronics14030422}
}
Start for free →