Incorporating Multimodal Directional Interpersonal Synchrony into Empathetic Response Generation
Sensors · 2025
DOI: 10.3390/s25020434 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Jingyu Quan und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Institute of Science Tokyo, Yokohama 226-8502, Japan. Hauptthemen laut MEDLINE: Empathy, Interpersonal Relations. Die Arbeit nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency, Japan Society for the Promotion of Science, JST SPRING.
Abstract (Originalsprache)
This study investigates how interpersonal (speaker–partner) synchrony contributes to empathetic response generation in communication scenarios. To perform this investigation, we propose a model that incorporates multimodal directional (positive and negative) interpersonal synchrony, operationalized using the cosine similarity measure, into empathetic response generation. We evaluate how incorporating specific synchrony affects the generated responses at the language and empathy levels. Based on comparison experiments, models with multimodal synchrony generate responses that are closer to ground truth responses and more diverse than models without synchrony. This demonstrates that these features are successfully integrated into the models. Additionally, we find that positive synchrony is linked to enhanced emotional reactions, reduced exploration, and improved interpretation. Negative synchrony is associated with reduced exploration and increased interpretation. These findings shed light on the connections between multimodal directional interpersonal synchrony and empathy’s emotional and cognitive aspects in artificial intelligence applications.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science, Institute of Science Tokyo, Yokohama 226-8502, Japan.
- Faculty of Engineering, University of Toyama, Toyama 930-8555, Japan.
ORCID-Profile: Jingyu Quan, Yoshihiro Miyake, Takayuki Nozawa
Förderung
- Japan Science and Technology Agency
- Japan Society for the Promotion of Science
- JST SPRING
- KAKENHI
Zitieren
APA
Quan, J., Miyake, Y., & Nozawa, T. (2025). Incorporating Multimodal Directional Interpersonal Synchrony into Empathetic Response Generation. Sensors. https://doi.org/10.3390/s25020434
Vancouver
Quan J, Miyake Y, Nozawa T. Incorporating Multimodal Directional Interpersonal Synchrony into Empathetic Response Generation. Sensors. 2025. doi:10.3390/s25020434
BibTeX
@article{Quan2025,
author = {Quan, Jingyu and Miyake, Yoshihiro and Nozawa, Takayuki},
title = {Incorporating Multimodal Directional Interpersonal Synchrony into Empathetic Response Generation},
journal = {Sensors},
year = {2025},
doi = {10.3390/s25020434}
}
EUVIMED