EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Incorporating Multimodal Directional Interpersonal Synchrony into Empathetic Response Generation

Jingyu Quan iD, Yoshihiro Miyake iD, Takayuki Nozawa iD

Sensors · 2025

DOI: 10.3390/s25020434 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Jingyu Quan und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, Institute of Science Tokyo, Yokohama 226-8502, Japan. Hauptthemen laut MEDLINE: Empathy, Interpersonal Relations. Die Arbeit nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency, Japan Society for the Promotion of Science, JST SPRING.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study investigates how interpersonal (speaker–partner) synchrony contributes to empathetic response generation in communication scenarios. To perform this investigation, we propose a model that incorporates multimodal directional (positive and negative) interpersonal synchrony, operationalized using the cosine similarity measure, into empathetic response generation. We evaluate how incorporating specific synchrony affects the generated responses at the language and empathy levels. Based on comparison experiments, models with multimodal synchrony generate responses that are closer to ground truth responses and more diverse than models without synchrony. This demonstrates that these features are successfully integrated into the models. Additionally, we find that positive synchrony is linked to enhanced emotional reactions, reduced exploration, and improved interpretation. Negative synchrony is associated with reduced exploration and increased interpretation. These findings shed light on the connections between multimodal directional interpersonal synchrony and empathy’s emotional and cognitive aspects in artificial intelligence applications.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

EmpathyInterpersonal RelationsHumansEmotionsMaleFemaleAdultArtificial IntelligenceYoung AdultCommunication

Stichwörter der Autor:innen

affective computingempathetic response generationmultimodal learning

Autor:innen und Institutionen

  • Department of Computer Science, Institute of Science Tokyo, Yokohama 226-8502, Japan.
  • Faculty of Engineering, University of Toyama, Toyama 930-8555, Japan.

ORCID-Profile: Jingyu Quan, Yoshihiro Miyake, Takayuki Nozawa

Förderung

  • Japan Science and Technology Agency
  • Japan Society for the Promotion of Science
  • JST SPRING
  • KAKENHI

Zitieren

APA

Quan, J., Miyake, Y., & Nozawa, T. (2025). Incorporating Multimodal Directional Interpersonal Synchrony into Empathetic Response Generation. Sensors. https://doi.org/10.3390/s25020434

Vancouver

Quan J, Miyake Y, Nozawa T. Incorporating Multimodal Directional Interpersonal Synchrony into Empathetic Response Generation. Sensors. 2025. doi:10.3390/s25020434

BibTeX
@article{Quan2025,
  author = {Quan, Jingyu and Miyake, Yoshihiro and Nozawa, Takayuki},
  title = {Incorporating Multimodal Directional Interpersonal Synchrony into Empathetic Response Generation},
  journal = {Sensors},
  year = {2025},
  doi = {10.3390/s25020434}
}
Kostenlos starten →