A Semantic‐to‐Motion Digital Twin Framework for Expressive Industrial Avatars in Telepresence
Computer Animation and Virtual Worlds · 2026-05 · 37 (3)
DOI: 10.1002/cav.70122 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Animation and Virtual Worlds, online erschienen am 31.05.2026. Verfasst von Damien Mazeas und 2 weiteren Autor:innen. Die Arbeit nennt 41 Literaturangaben. Gefördert von: Bpifrance.
Abstract (Originalsprache)
Remote industrial assistance is increasingly mediated through robotic avatars, yet existing telepresence systems provide limited support for non‐verbal behaviors such as hesitation, urgency, or emphasis. Manually controlling such expressive motion can increase operator workload. We present a feasibility and system‐integration study of a semantic‐to‐motion telepresence pipeline that interprets expert utterances and scene context into parameterized expressive robot behaviors. The system combines visual grounding with language‐based intent inference to produce structured motion descriptors, which are mapped to procedural motion primitives executed in a unity‐based digital twin and streamed to a physical robot via ROS. As the semantic control vocabulary for this prototype, we define SAEH (show, alert, encourage, hesitate), a four‐class operational vocabulary derived from a thematic review of 104 HRI papers. We implement the approach on a Niryo Ned 1 manipulator and show that it can generate and execute kinematically distinct expressive motion profiles, including deictic, warning, supportive, and hesitant behaviors. The proposed framework partially separates communicative intent from robot‐specific execution through parameterized procedural primitives, providing a technical foundation for context‐aware expressive telepresence; however, a measured mean end‐to‐end latency of 10 s currently limits its use to supervisory and asynchronous task loops rather than continuous live interaction.
Förderung
- Bpifrance
Zitieren
APA
Mazeas, D., Foulonneau, A., & Lacoche, J. (2026). A Semantic‐to‐Motion Digital Twin Framework for Expressive Industrial Avatars in Telepresence. Computer Animation and Virtual Worlds, 37(3). https://doi.org/10.1002/cav.70122
Vancouver
Mazeas D, Foulonneau A, Lacoche J. A Semantic‐to‐Motion Digital Twin Framework for Expressive Industrial Avatars in Telepresence. Computer Animation and Virtual Worlds. 2026;37(3). doi:10.1002/cav.70122
BibTeX
@article{Mazeas2026,
author = {Mazeas, Damien and Foulonneau, Anthony and Lacoche, Jérémy},
title = {A Semantic‐to‐Motion Digital Twin Framework for Expressive Industrial Avatars in Telepresence},
journal = {Computer Animation and Virtual Worlds},
year = {2026},
volume = {37},
number = {3},
doi = {10.1002/cav.70122}
}
EUVIMED