EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-Horizon Stress Forecasting From Emotional Speech Sequences Using Temporal Convolutional Networks and Self-Attention

Pallapu Krishna Vamsi, T. Santhi Sri

Adolescência e Saúde · 04.10.2026 · 212-228

DOI: 10.67440/ahj.vi.2500 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Adolescência e Saúde, online erschienen am 04.10.2026. Verfasst von Pallapu Krishna Vamsi und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Classic stress detection is based on fixed classification of the existing states which restricts proactive interventions. The paper presents a new multi-horizon forecasting model to estimate the future stress levels (3, 6 and 9 seconds into the future) using temporal speech-derived sequences. We introduce a Multi-Task Temporal Convolutional Network with Attention (MT-TCN-Att), that combines dilated causal convolution, multi-head self-attention, and learnable positional encoding to learn complex temporal relationships. A composite loss of time smoothness and mixup augmentation is used to optimize the model. The model performs well on CREMA-D dataset, with an F1-score of 0.9208 at a horizon of 9 seconds. Ablation experiments indicate that a 30-second lookback window is optimal in capturing deterministic emotional transitions whereas the learnable positional encoding can be naturally explained by emphasising the significance of historical baselines. Zero-shot cross-dataset tests on RAVDESS and EMOdB, however, reveal the presence of important domain shifts, demonstrating the difficulty of trained performance generalization to different acoustic contexts. Finally, this paper has provided the first step towards adaptable horizons of acoustic stress prediction allowing the real-time, proactive approach to mental health interventions.

Zitieren

APA

Vamsi, P. K., & Sri, T. S. (2026). Multi-Horizon Stress Forecasting From Emotional Speech Sequences Using Temporal Convolutional Networks and Self-Attention. Adolescência e Saúde, 212-228. https://doi.org/10.67440/ahj.vi.2500

Vancouver

Vamsi PK, Sri TS. Multi-Horizon Stress Forecasting From Emotional Speech Sequences Using Temporal Convolutional Networks and Self-Attention. Adolescência e Saúde. 2026:212-228. doi:10.67440/ahj.vi.2500

BibTeX
@article{Vamsi2026,
  author = {Vamsi, Pallapu Krishna and Sri, T. Santhi},
  title = {Multi-Horizon Stress Forecasting From Emotional Speech Sequences Using Temporal Convolutional Networks and Self-Attention},
  journal = {Adolescência e Saúde},
  year = {2026},
  pages = {212--228},
  doi = {10.67440/ahj.vi.2500}
}
Kostenlos starten →