Human-robot facial coexpression
Science Robotics · 27.03.2024 · 9 (88)
DOI: 10.1126/scirobotics.adi4724 ↗Kurz gefasst
Fachartikel in der Zeitschrift Science Robotics, erschienen am 27.03.2024. Verfasst von Yuhang Hu und 6 weiteren Autor:innen. Beteiligte Einrichtung: Creative Machines Laboratory, Department of Mechanical Engineering, Columbia University, New York, NY 10027, USA. Hauptthemen laut MEDLINE: Robotics. Die Arbeit wurde bisher 57-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: US National Science Foundation (NSF) AI Institute for Dynamical Systems (DynamicsAI.org).
Abstract (Originalsprache)
Large language models are enabling rapid progress in robotic verbal communication, but nonverbal communication is not keeping pace. Physical humanoid robots struggle to express and communicate using facial movement, relying primarily on voice. The challenge is twofold: First, the actuation of an expressively versatile robotic face is mechanically challenging. A second challenge is knowing what expression to generate so that the robot appears natural, timely, and genuine. Here, we propose that both barriers can be alleviated by training a robot to anticipate future facial expressions and execute them simultaneously with a human. Whereas delayed facial mimicry looks disingenuous, facial coexpression feels more genuine because it requires correct inference of the human’s emotional state for timely execution. We found that a robot can learn to predict a forthcoming smile about 839 milliseconds before the human smiles and, using a learned inverse kinematic facial self-model, coexpress the smile simultaneously with the human. We demonstrated this ability using a robot face comprising 26 degrees of freedom. We believe that the ability to coexpress simultaneous facial expressions could improve human-robot interaction.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Creative Machines Laboratory, Department of Mechanical Engineering, Columbia University, New York, NY 10027, USA.
- Mechanical Engineering and Materials Department, Duke University, Durham, NC 27708, USA.
- Department of Electrical and Computer Engineering, Duke University, Durham, NC 27708, USA.
- Department of Computer Science, Duke University, Durham, NC 27708, USA.
- Department of Computer Science, Columbia University, New York, NY 10027, USA.
- Data Science Institute, Columbia University, New York, NY, 10027, USA.
ORCID-Profile: Yuhang Hu, Boyuan Chen, Jiong Lin, Yunzhe Wang, Yingke Wang, Cameron Mehlman, Hod Lipson
Förderung
- US National Science Foundation (NSF) AI Institute for Dynamical Systems (DynamicsAI.org)
Zitieren
APA
Hu, Y., Chen, B., Lin, J., Wang, Y., Wang, Y., Mehlman, C., & Lipson, H. (2024). Human-robot facial coexpression. Science Robotics, 9(88). https://doi.org/10.1126/scirobotics.adi4724
Vancouver
Hu Y, Chen B, Lin J, Wang Y, Wang Y, Mehlman C, et al. Human-robot facial coexpression. Science Robotics. 2024;9(88). doi:10.1126/scirobotics.adi4724
BibTeX
@article{Hu2024,
author = {Hu, Yuhang and Chen, Boyuan and Lin, Jiong and Wang, Yunzhe and Wang, Yingke and Mehlman, Cameron and Lipson, Hod},
title = {Human-robot facial coexpression},
journal = {Science Robotics},
year = {2024},
volume = {9},
number = {88},
doi = {10.1126/scirobotics.adi4724}
}
EUVIMED