EUVIMEDEUVIMED entdecken
Crossref

A Semantic‐to‐Motion Digital Twin Framework for Expressive Industrial Avatars in Telepresence

Damien Mazeas, Anthony Foulonneau, Jérémy Lacoche

Computer Animation and Virtual Worlds · 2026-05 · 37 (3)

DOI: 10.1002/cav.70122 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Animation and Virtual Worlds, online erschienen am 31.05.2026. Verfasst von Damien Mazeas und 2 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Gefördert von: Bpifrance.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Remote industrial assistance is increasingly mediated through robotic avatars, yet existing telepresence systems provide limited support for non‐verbal behaviors such as hesitation, urgency, or emphasis. Manually controlling such expressive motion can increase operator workload. We present a feasibility and system‐integration study of a semantic‐to‐motion telepresence pipeline that interprets expert utterances and scene context into parameterized expressive robot behaviors. The system combines visual grounding with language‐based intent inference to produce structured motion descriptors, which are mapped to procedural motion primitives executed in a unity‐based digital twin and streamed to a physical robot via ROS. As the semantic control vocabulary for this prototype, we define SAEH (show, alert, encourage, hesitate), a four‐class operational vocabulary derived from a thematic review of 104 HRI papers. We implement the approach on a Niryo Ned 1 manipulator and show that it can generate and execute kinematically distinct expressive motion profiles, including deictic, warning, supportive, and hesitant behaviors. The proposed framework partially separates communicative intent from robot‐specific execution through parameterized procedural primitives, providing a technical foundation for context‐aware expressive telepresence; however, a measured mean end‐to‐end latency of 10 s currently limits its use to supervisory and asynchronous task loops rather than continuous live interaction.

Förderung

  • Bpifrance

Zitieren

APA

Mazeas, D., Foulonneau, A., & Lacoche, J. (2026). A Semantic‐to‐Motion Digital Twin Framework for Expressive Industrial Avatars in Telepresence. Computer Animation and Virtual Worlds, 37(3). https://doi.org/10.1002/cav.70122

Vancouver

Mazeas D, Foulonneau A, Lacoche J. A Semantic‐to‐Motion Digital Twin Framework for Expressive Industrial Avatars in Telepresence. Computer Animation and Virtual Worlds. 2026;37(3). doi:10.1002/cav.70122

BibTeX
@article{Mazeas2026,
  author = {Mazeas, Damien and Foulonneau, Anthony and Lacoche, Jérémy},
  title = {A Semantic‐to‐Motion Digital Twin Framework for Expressive Industrial Avatars in Telepresence},
  journal = {Computer Animation and Virtual Worlds},
  year = {2026},
  volume = {37},
  number = {3},
  doi = {10.1002/cav.70122}
}
Kostenlos starten →