EUVIMEDEUVIMED entdecken
Crossref

Sensory Substitution and Embodiment Shape Performance and Immersion in Teleoperated Settings

Valentina Cesari iD, Giorgia Papini iD, Andrea Piarulli iD, Yuri De Pra, Angelo Gemignani iD, Matteo Bianchi iD, Danilo Menicucci iD

Psychophysiology · 2026

DOI: 10.1111/psyp.70244 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Psychophysiology, 2026. Verfasst von Valentina Cesari und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surgical, Medical and Molecular Pathology and Critical Care Medicine, University of Pisa, Pisa, Italy. Hauptthemen laut MEDLINE: Psychomotor Performance, Touch Perception, Learning, Visual Perception. Die Arbeit nennt 73 Literaturangaben. Gefördert von: European Union - Next Generation EU, in the context of the National Recovery and Resilience Plan, THE - Tuscany Health Ecosystem, CUP I53C22000780001 - Spoke 9…, Ministero dell'Università e della Ricerca.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Telemanipulation allows remote operations using specialized tools, often under limited sensory input, such as the absence of haptic feedback. With practice, these tools can become embodied extensions of the user, enhancing Presence. Sensory Substitution, conveying information from one sensory modality through another, can mitigate sensory limitations in such tasks. We developed the Visual‐Tactile Sensory Substitution Task to investigate learning of Sensory Substitution while accounting for Embodiment and Presence experience. Forty participants completed a within‐subjects repeated‐measures design in which each individual was required to manipulate 200 virtual elastic slabs using a haptic stylus to maximize deformation without breakage. Each participant performed two trial types in random order: 50% with force feedback (Control Condition) and 50% without it (Sensory Substitution Condition). Performance metrics included Frequency of Errors, Elapsed Time, Maximal Applied Force, along with Maximal Pupil Dilation and Number of Blinks as workload and learning indicators. Participants also assessed their Perceived Sensory Substitution, Embodiment, and Presence after the task. All metrics were analyzed separately for correct, incorrect, and aggregated trials. Structural Equation Modeling was applied to test the effects of Perceived Sensory Substitution (exogenous variable) on Sensory Substitution Learning via Embodiment and Presence (endogenous variables). Participants in the Sensory Substitution Condition showed reduced Elapsed Time, comparable Maximal Applied Force, and higher Frequency of Errors compared to the Control Condition. Blink rate showed phase‐dependent modulation during correct trials, consistent with task learning, while pupil dilation remained stable across phases and feedback conditions. Structural Equation Modeling revealed that Perceived Sensory Substitution positively influenced Embodiment, Presence, and Learning. Overall, Sensory Substitution supports telemanipulation by fostering Embodiment and reducing task time, while modulating sensorimotor learning strategies relevant for efficient remote operation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Psychomotor PerformanceTouch PerceptionLearningVisual PerceptionFeedback, SensoryHumansFemaleMaleAdultYoung Adult

Stichwörter der Autor:innen

embodimentlearningmultisensory integrationrobotic surgerysensory substitution learningteleoperation

Autor:innen und Institutionen

  • Department of Surgical, Medical and Molecular Pathology and Critical Care Medicine, University of Pisa, Pisa, Italy.
  • Department of Energy Technologies and Renewable Sources (TERIN), Laboratory for Hydrogen and New Energy Vectors (H2V), ENEA-Italian National Agency for New Technologies, Energy and Sustainable Economic Development, Casa…
  • Department of Information Engineering and Research Center "E. Piaggio", University of Pisa, Pisa, Italy.

ORCID-Profile: Valentina Cesari, Giorgia Papini, Andrea Piarulli, Angelo Gemignani, Matteo Bianchi, Danilo Menicucci

Förderung

  • European Union - Next Generation EU, in the context of the National Recovery and Resilience Plan, THE - Tuscany Health Ecosystem, CUP I53C22000780001 - Spoke 9…
  • Ministero dell'Università e della Ricerca

Zitieren

APA

Cesari, V., Papini, G., Piarulli, A., De Pra, Y., Gemignani, A., Bianchi, M., & Menicucci, D. (2026). Sensory Substitution and Embodiment Shape Performance and Immersion in Teleoperated Settings. Psychophysiology. https://doi.org/10.1111/psyp.70244

Vancouver

Cesari V, Papini G, Piarulli A, De Pra Y, Gemignani A, Bianchi M, et al. Sensory Substitution and Embodiment Shape Performance and Immersion in Teleoperated Settings. Psychophysiology. 2026. doi:10.1111/psyp.70244

BibTeX
@article{Cesari2026,
  author = {Cesari, Valentina and Papini, Giorgia and Piarulli, Andrea and De Pra, Yuri and Gemignani, Angelo and Bianchi, Matteo and Menicucci, Danilo},
  title = {Sensory Substitution and Embodiment Shape Performance and Immersion in Teleoperated Settings},
  journal = {Psychophysiology},
  year = {2026},
  doi = {10.1111/psyp.70244}
}
Kostenlos starten →