The Acoustically Emotion-Aware Conversational Agent With Speech Emotion Recognition and Empathetic Responses
IEEE Transactions on Affective Computing · 01.01.2023 · 14 (1) · 17-30
DOI: 10.1109/taffc.2022.3205919 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, erschienen am 01.01.2023. Verfasst von Jiaxiong Hu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 63-mal zitiert (Crossref) und nennt 81 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Tsinghua University Initiative Scientific Research Program, Tsinghua University-Alibaba Joint Research Laboratory for Natural Interaction Experience.
Abstract (Originalsprache)
Emotion is important for the conversational user interface. In prior research, conversational agents (CAs) employ natural language process techniques to create affective interaction based on text. However, the use of acoustic features of speech for voice-based CAs is under exploration. This work presents an acoustically emotion-aware CA that enables speech emotion recognition and stylizes responses with empathetic feedback and interjections. We conducted an experiment with 75 participants to evaluate their perceived emotional intelligence (PEI) after interacting with the CA. Our results show that the acoustical emotion-awareness increased the participants’ PEI of the CA, and the empathetic responses from the CA helped alleviate some participants’ negative emotions. Our work provides implications for designing future CAs with better PEI.
Förderung
- National Natural Science Foundation of China
- Tsinghua University Initiative Scientific Research Program
- Tsinghua University-Alibaba Joint Research Laboratory for Natural Interaction Experience
Zitieren
APA
Hu, J., Huang, Y., Hu, X., & Xu, Y. (2023). The Acoustically Emotion-Aware Conversational Agent With Speech Emotion Recognition and Empathetic Responses. IEEE Transactions on Affective Computing, 14(1), 17-30. https://doi.org/10.1109/taffc.2022.3205919
Vancouver
Hu J, Huang Y, Hu X, Xu Y. The Acoustically Emotion-Aware Conversational Agent With Speech Emotion Recognition and Empathetic Responses. IEEE Transactions on Affective Computing. 2023;14(1):17-30. doi:10.1109/taffc.2022.3205919
BibTeX
@article{Hu2023,
author = {Hu, Jiaxiong and Huang, Yun and Hu, Xiaozhu and Xu, Yingqing},
title = {The Acoustically Emotion-Aware Conversational Agent With Speech Emotion Recognition and Empathetic Responses},
journal = {IEEE Transactions on Affective Computing},
year = {2023},
volume = {14},
number = {1},
pages = {17--30},
doi = {10.1109/taffc.2022.3205919}
}
EUVIMED