Emotion Forecasting: A Transformer-Based Approach
Journal of Medical Internet Research · 18.03.2025 · 27 · e63962
DOI: 10.2196/63962 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Medical Internet Research, online erschienen am 18.03.2025. Verfasst von Leire Paz-Arbaizar und 4 weiteren Autor:innen. Beteiligte Einrichtung: Signal Theory and Communications Department, Universidad Carlos III de Madrid, Leganés, Spain. Hauptthemen laut MEDLINE: Emotions, Mental Disorders. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Monitoring the emotional states of patients with psychiatric problems has always been challenging due to the noncontinuous nature of clinical assessments, the effect of the health care environment, and the inherent subjectivity of evaluation instruments. However, mental states in psychiatric disorders exhibit substantial variability over time, making real-time monitoring crucial for preventing risky situations and ensuring appropriate treatment.
Objective
This study aimed to leverage new technologies and deep learning techniques to enable more objective, real-time monitoring of patients. This was achieved by passively monitoring variables such as step count, patient location, and sleep patterns using mobile devices. We aimed to predict patient self-reports and detect sudden variations in their emotional valence, identifying situations that may require clinical intervention.
Methods
Data for this project were collected using the Evidence-Based Behavior (eB2) app, which records both passive and self-reported variables daily. Passive data refer to behavioral information gathered via the eB2 app through sensors embedded in mobile devices and wearables. These data were obtained from studies conducted in collaboration with hospitals and clinics that used eB2. We used hidden Markov models (HMMs) to address missing data and transformer deep neural networks for time-series forecasting. Finally, classification algorithms were applied to predict several variables, including emotional state and responses to the Patient Health Questionnaire-9.
Results
Through real-time patient monitoring, we demonstrated the ability to accurately predict patients’ emotional states and anticipate changes over time. Specifically, our approach achieved high accuracy (0.93) and a receiver operating characteristic (ROC) area under the curve (AUC) of 0.98 for emotional valence classification. For predicting emotional state changes 1 day in advance, we obtained an ROC AUC of 0.87. Furthermore, we demonstrated the feasibility of forecasting responses to the Patient Health Questionnaire-9, with particularly strong performance for certain questions. For example, in question 9, related to suicidal ideation, our model achieved an accuracy of 0.9 and an ROC AUC of 0.77 for predicting the next day’s response. Moreover, we illustrated the enhanced stability of multivariate time-series forecasting when HMM preprocessing was combined with a transformer model, as opposed to other time-series forecasting methods, such as recurrent neural networks or long short-term memory cells.
Conclusions
The stability of multivariate time-series forecasting improved when HMM preprocessing was combined with a transformer model, as opposed to other time-series forecasting methods (eg, recurrent neural network and long short-term memory), leveraging the attention mechanisms to capture longer time dependencies and gain interpretability. We showed the potential to assess the emotional state of a patient and the scores of psychiatric questionnaires from passive variables in advance. This allows real-time monitoring of patients and hence better risk detection and treatment adjustment.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Signal Theory and Communications Department, Universidad Carlos III de Madrid, Leganés, Spain.
- Department of Psychiatry, Public Health, Radiology, Nursing and Medicine, University of Santiago de Compostela, Santiago de Compostela, Spain.
- Centro de Investigación Biomédica en Red de Salud Mental, Madrid, Spain.
- Department of Adult Psychiatry, Nimes University Hospital, Nimes, France.
- Instituto de Investigacion Sanitaria Gregorio Marañón, Madrid, Spain.
- Evidence-Based Behavior (eB2), Leganés, Spain.
ORCID-Profile: Leire Paz-Arbaizar, Jorge Lopez-Castroman, Antonio Artés-Rodríguez, Pablo M Olmos, David Ramírez
Zitieren
APA
Paz-Arbaizar, L., Lopez-Castroman, J., Artés-Rodríguez, A., Olmos, P. M., & Ramírez, D. (2025). Emotion Forecasting: A Transformer-Based Approach. Journal of Medical Internet Research, 27, e63962. https://doi.org/10.2196/63962
Vancouver
Paz-Arbaizar L, Lopez-Castroman J, Artés-Rodríguez A, Olmos PM, Ramírez D. Emotion Forecasting: A Transformer-Based Approach. Journal of Medical Internet Research. 2025;27:e63962. doi:10.2196/63962
BibTeX
@article{PazArbaizar2025,
author = {Paz-Arbaizar, Leire and Lopez-Castroman, Jorge and Artés-Rodríguez, Antonio and Olmos, Pablo M and Ramírez, David},
title = {Emotion Forecasting: A Transformer-Based Approach},
journal = {Journal of Medical Internet Research},
year = {2025},
volume = {27},
pages = {e63962},
doi = {10.2196/63962}
}
EUVIMED