EUVIMEDEUVIMED entdecken
Open Access

Emotion Forecasting: A Transformer-Based Approach

Leire Paz-Arbaizar iD, Jorge Lopez-Castroman iD, Antonio Artés-Rodríguez iD, Pablo M Olmos iD, David Ramírez iD

Journal of Medical Internet Research · 18.03.2025 · 27 · e63962

DOI: 10.2196/63962 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Medical Internet Research, online erschienen am 18.03.2025. Verfasst von Leire Paz-Arbaizar und 4 weiteren Autor:innen. Beteiligte Einrichtung: Signal Theory and Communications Department, Universidad Carlos III de Madrid, Leganés, Spain. Hauptthemen laut MEDLINE: Emotions, Mental Disorders. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Monitoring the emotional states of patients with psychiatric problems has always been challenging due to the noncontinuous nature of clinical assessments, the effect of the health care environment, and the inherent subjectivity of evaluation instruments. However, mental states in psychiatric disorders exhibit substantial variability over time, making real-time monitoring crucial for preventing risky situations and ensuring appropriate treatment.

Objective

This study aimed to leverage new technologies and deep learning techniques to enable more objective, real-time monitoring of patients. This was achieved by passively monitoring variables such as step count, patient location, and sleep patterns using mobile devices. We aimed to predict patient self-reports and detect sudden variations in their emotional valence, identifying situations that may require clinical intervention.

Methods

Data for this project were collected using the Evidence-Based Behavior (eB2) app, which records both passive and self-reported variables daily. Passive data refer to behavioral information gathered via the eB2 app through sensors embedded in mobile devices and wearables. These data were obtained from studies conducted in collaboration with hospitals and clinics that used eB2. We used hidden Markov models (HMMs) to address missing data and transformer deep neural networks for time-series forecasting. Finally, classification algorithms were applied to predict several variables, including emotional state and responses to the Patient Health Questionnaire-9.

Results

Through real-time patient monitoring, we demonstrated the ability to accurately predict patients’ emotional states and anticipate changes over time. Specifically, our approach achieved high accuracy (0.93) and a receiver operating characteristic (ROC) area under the curve (AUC) of 0.98 for emotional valence classification. For predicting emotional state changes 1 day in advance, we obtained an ROC AUC of 0.87. Furthermore, we demonstrated the feasibility of forecasting responses to the Patient Health Questionnaire-9, with particularly strong performance for certain questions. For example, in question 9, related to suicidal ideation, our model achieved an accuracy of 0.9 and an ROC AUC of 0.77 for predicting the next day’s response. Moreover, we illustrated the enhanced stability of multivariate time-series forecasting when HMM preprocessing was combined with a transformer model, as opposed to other time-series forecasting methods, such as recurrent neural networks or long short-term memory cells.

Conclusions

The stability of multivariate time-series forecasting improved when HMM preprocessing was combined with a transformer model, as opposed to other time-series forecasting methods (eg, recurrent neural network and long short-term memory), leveraging the attention mechanisms to capture longer time dependencies and gain interpretability. We showed the potential to assess the emotional state of a patient and the scores of psychiatric questionnaires from passive variables in advance. This allows real-time monitoring of patients and hence better risk detection and treatment adjustment.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EmotionsMental DisordersHumansForecastingMaleMobile ApplicationsDeep LearningFemaleNeural Networks, ComputerAdult

Stichwörter der Autor:innen

PHQ-9Patient Health Questionnaire-9affectemotional valencemachine learningmental disordermonitoringmoodpassive datapsychological distresstime-series forecasting

Autor:innen und Institutionen

  • Signal Theory and Communications Department, Universidad Carlos III de Madrid, Leganés, Spain.
  • Department of Psychiatry, Public Health, Radiology, Nursing and Medicine, University of Santiago de Compostela, Santiago de Compostela, Spain.
  • Centro de Investigación Biomédica en Red de Salud Mental, Madrid, Spain.
  • Department of Adult Psychiatry, Nimes University Hospital, Nimes, France.
  • Instituto de Investigacion Sanitaria Gregorio Marañón, Madrid, Spain.
  • Evidence-Based Behavior (eB2), Leganés, Spain.

ORCID-Profile: Leire Paz-Arbaizar, Jorge Lopez-Castroman, Antonio Artés-Rodríguez, Pablo M Olmos, David Ramírez

Zitieren

APA

Paz-Arbaizar, L., Lopez-Castroman, J., Artés-Rodríguez, A., Olmos, P. M., & Ramírez, D. (2025). Emotion Forecasting: A Transformer-Based Approach. Journal of Medical Internet Research, 27, e63962. https://doi.org/10.2196/63962

Vancouver

Paz-Arbaizar L, Lopez-Castroman J, Artés-Rodríguez A, Olmos PM, Ramírez D. Emotion Forecasting: A Transformer-Based Approach. Journal of Medical Internet Research. 2025;27:e63962. doi:10.2196/63962

BibTeX
@article{PazArbaizar2025,
  author = {Paz-Arbaizar, Leire and Lopez-Castroman, Jorge and Artés-Rodríguez, Antonio and Olmos, Pablo M and Ramírez, David},
  title = {Emotion Forecasting: A Transformer-Based Approach},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  volume = {27},
  pages = {e63962},
  doi = {10.2196/63962}
}
Kostenlos starten →