Sensory Substitution and Embodiment Shape Performance and Immersion in Teleoperated Settings
Psychophysiology · 2026
DOI: 10.1111/psyp.70244 ↗Kurz gefasst
Fachartikel in der Zeitschrift Psychophysiology, 2026. Verfasst von Valentina Cesari und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgical, Medical and Molecular Pathology and Critical Care Medicine, University of Pisa, Pisa, Italy. Hauptthemen laut MEDLINE: Psychomotor Performance, Touch Perception, Learning, Visual Perception. Die Arbeit nennt 73 Literaturangaben. Gefördert von: European Union - Next Generation EU, in the context of the National Recovery and Resilience Plan, THE - Tuscany Health Ecosystem, CUP I53C22000780001 - Spoke 9…, Ministero dell'Università e della Ricerca.
Abstract (Originalsprache)
Telemanipulation allows remote operations using specialized tools, often under limited sensory input, such as the absence of haptic feedback. With practice, these tools can become embodied extensions of the user, enhancing Presence. Sensory Substitution, conveying information from one sensory modality through another, can mitigate sensory limitations in such tasks. We developed the Visual‐Tactile Sensory Substitution Task to investigate learning of Sensory Substitution while accounting for Embodiment and Presence experience. Forty participants completed a within‐subjects repeated‐measures design in which each individual was required to manipulate 200 virtual elastic slabs using a haptic stylus to maximize deformation without breakage. Each participant performed two trial types in random order: 50% with force feedback (Control Condition) and 50% without it (Sensory Substitution Condition). Performance metrics included Frequency of Errors, Elapsed Time, Maximal Applied Force, along with Maximal Pupil Dilation and Number of Blinks as workload and learning indicators. Participants also assessed their Perceived Sensory Substitution, Embodiment, and Presence after the task. All metrics were analyzed separately for correct, incorrect, and aggregated trials. Structural Equation Modeling was applied to test the effects of Perceived Sensory Substitution (exogenous variable) on Sensory Substitution Learning via Embodiment and Presence (endogenous variables). Participants in the Sensory Substitution Condition showed reduced Elapsed Time, comparable Maximal Applied Force, and higher Frequency of Errors compared to the Control Condition. Blink rate showed phase‐dependent modulation during correct trials, consistent with task learning, while pupil dilation remained stable across phases and feedback conditions. Structural Equation Modeling revealed that Perceived Sensory Substitution positively influenced Embodiment, Presence, and Learning. Overall, Sensory Substitution supports telemanipulation by fostering Embodiment and reducing task time, while modulating sensorimotor learning strategies relevant for efficient remote operation.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Surgical, Medical and Molecular Pathology and Critical Care Medicine, University of Pisa, Pisa, Italy.
- Department of Energy Technologies and Renewable Sources (TERIN), Laboratory for Hydrogen and New Energy Vectors (H2V), ENEA-Italian National Agency for New Technologies, Energy and Sustainable Economic Development, Casa…
- Department of Information Engineering and Research Center "E. Piaggio", University of Pisa, Pisa, Italy.
ORCID-Profile: Valentina Cesari, Giorgia Papini, Andrea Piarulli, Angelo Gemignani, Matteo Bianchi, Danilo Menicucci
Förderung
- European Union - Next Generation EU, in the context of the National Recovery and Resilience Plan, THE - Tuscany Health Ecosystem, CUP I53C22000780001 - Spoke 9…
- Ministero dell'Università e della Ricerca
Zitieren
APA
Cesari, V., Papini, G., Piarulli, A., De Pra, Y., Gemignani, A., Bianchi, M., & Menicucci, D. (2026). Sensory Substitution and Embodiment Shape Performance and Immersion in Teleoperated Settings. Psychophysiology. https://doi.org/10.1111/psyp.70244
Vancouver
Cesari V, Papini G, Piarulli A, De Pra Y, Gemignani A, Bianchi M, et al. Sensory Substitution and Embodiment Shape Performance and Immersion in Teleoperated Settings. Psychophysiology. 2026. doi:10.1111/psyp.70244
BibTeX
@article{Cesari2026,
author = {Cesari, Valentina and Papini, Giorgia and Piarulli, Andrea and De Pra, Yuri and Gemignani, Angelo and Bianchi, Matteo and Menicucci, Danilo},
title = {Sensory Substitution and Embodiment Shape Performance and Immersion in Teleoperated Settings},
journal = {Psychophysiology},
year = {2026},
doi = {10.1111/psyp.70244}
}
EUVIMED