EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Novel Speech-Based Emotion Climate Recognition in Peers’ Conversations Incorporating Affect Dynamics and Temporal Convolutional Neural Networks

Ghada Alhussein, Mohanad Alkhodari, Ahsan H. Khandoker, Leontios J. Hadjileontiadis

IEEE Access · 2025 · 13 · 16752-16769

DOI: 10.1109/access.2025.3529125 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2025. Verfasst von Ghada Alhussein und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 80 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Khalifa University, Abu Dhabi, United Arab Emirates,.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Peers’ conversation provides a domain of rich emotional information. The latter, apart from facial and gestural expressions, it is also naturally conveyed via peers’ speech, contributing to the establishment of a dynamic emotion climate (EC) during their conversational interaction. Recognition of EC could provide an additional source in understating peers’ social interaction and behavior on top of peers’ actual conversational content.We propose a novel approach for speech-based EC recognition, termed AffECt, which combines peers’ complex affect dynamics (AD) with deep features extracted from speech signals using Temporal Convolutional Neural Networks (TCNNs). AffECt was tested and cross-validated on data drawn from there open datasets, i.e., K-EmoCon, IEMOCAP, and SEWA, in terms of EC arousal/valence level classification. The experimental results have shown that AffECt achieves EC classification accuracy up to 83.3% and 80.2% for arousal and valence, respectively, clearly surpassing the results reported in the literature, exhibiting robust performance across different languages. Moreover, there is a distinct improvement when the AD are combined with the TCNN, compared to the baseline deep learning approaches. These results demonstrate the effectiveness of AffECt in speech-based EC recognition, paving the way for many applications, e.g., in patients’ group therapy, negotiations, and emotion-aware mobile applications.

Förderung

  • Khalifa University, Abu Dhabi, United Arab Emirates,

Zitieren

APA

Alhussein, G., Alkhodari, M., Khandoker, A. H., & Hadjileontiadis, L. J. (2025). Novel Speech-Based Emotion Climate Recognition in Peers’ Conversations Incorporating Affect Dynamics and Temporal Convolutional Neural Networks. IEEE Access, 13, 16752-16769. https://doi.org/10.1109/access.2025.3529125

Vancouver

Alhussein G, Alkhodari M, Khandoker AH, Hadjileontiadis LJ. Novel Speech-Based Emotion Climate Recognition in Peers’ Conversations Incorporating Affect Dynamics and Temporal Convolutional Neural Networks. IEEE Access. 2025;13:16752-16769. doi:10.1109/access.2025.3529125

BibTeX
@article{Alhussein2025,
  author = {Alhussein, Ghada and Alkhodari, Mohanad and Khandoker, Ahsan H. and Hadjileontiadis, Leontios J.},
  title = {Novel Speech-Based Emotion Climate Recognition in Peers’ Conversations Incorporating Affect Dynamics and Temporal Convolutional Neural Networks},
  journal = {IEEE Access},
  year = {2025},
  volume = {13},
  pages = {16752--16769},
  doi = {10.1109/access.2025.3529125}
}
Kostenlos starten →