EUVIMEDEUVIMED entdecken
Crossref

Human-robot facial coexpression

Yuhang Hu iD, Boyuan Chen iD, Jiong Lin iD, Yunzhe Wang iD, Yingke Wang iD, Cameron Mehlman iD, Hod Lipson iD

Science Robotics · 27.03.2024 · 9 (88)

DOI: 10.1126/scirobotics.adi4724 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Science Robotics, erschienen am 27.03.2024. Verfasst von Yuhang Hu und 6 weiteren Autor:innen. Beteiligte Einrichtung: Creative Machines Laboratory, Department of Mechanical Engineering, Columbia University, New York, NY 10027, USA. Hauptthemen laut MEDLINE: Robotics. Die Arbeit wurde bisher 57-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: US National Science Foundation (NSF) AI Institute for Dynamical Systems (DynamicsAI.org).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models are enabling rapid progress in robotic verbal communication, but nonverbal communication is not keeping pace. Physical humanoid robots struggle to express and communicate using facial movement, relying primarily on voice. The challenge is twofold: First, the actuation of an expressively versatile robotic face is mechanically challenging. A second challenge is knowing what expression to generate so that the robot appears natural, timely, and genuine. Here, we propose that both barriers can be alleviated by training a robot to anticipate future facial expressions and execute them simultaneously with a human. Whereas delayed facial mimicry looks disingenuous, facial coexpression feels more genuine because it requires correct inference of the human’s emotional state for timely execution. We found that a robot can learn to predict a forthcoming smile about 839 milliseconds before the human smiles and, using a learned inverse kinematic facial self-model, coexpress the smile simultaneously with the human. We demonstrated this ability using a robot face comprising 26 degrees of freedom. We believe that the ability to coexpress simultaneous facial expressions could improve human-robot interaction.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RoboticsHumansMovementLearningBiomimetics

Autor:innen und Institutionen

  • Creative Machines Laboratory, Department of Mechanical Engineering, Columbia University, New York, NY 10027, USA.
  • Mechanical Engineering and Materials Department, Duke University, Durham, NC 27708, USA.
  • Department of Electrical and Computer Engineering, Duke University, Durham, NC 27708, USA.
  • Department of Computer Science, Duke University, Durham, NC 27708, USA.
  • Department of Computer Science, Columbia University, New York, NY 10027, USA.
  • Data Science Institute, Columbia University, New York, NY, 10027, USA.

ORCID-Profile: Yuhang Hu, Boyuan Chen, Jiong Lin, Yunzhe Wang, Yingke Wang, Cameron Mehlman, Hod Lipson

Förderung

  • US National Science Foundation (NSF) AI Institute for Dynamical Systems (DynamicsAI.org)

Zitieren

APA

Hu, Y., Chen, B., Lin, J., Wang, Y., Wang, Y., Mehlman, C., & Lipson, H. (2024). Human-robot facial coexpression. Science Robotics, 9(88). https://doi.org/10.1126/scirobotics.adi4724

Vancouver

Hu Y, Chen B, Lin J, Wang Y, Wang Y, Mehlman C, et al. Human-robot facial coexpression. Science Robotics. 2024;9(88). doi:10.1126/scirobotics.adi4724

BibTeX
@article{Hu2024,
  author = {Hu, Yuhang and Chen, Boyuan and Lin, Jiong and Wang, Yunzhe and Wang, Yingke and Mehlman, Cameron and Lipson, Hod},
  title = {Human-robot facial coexpression},
  journal = {Science Robotics},
  year = {2024},
  volume = {9},
  number = {88},
  doi = {10.1126/scirobotics.adi4724}
}
Kostenlos starten →