EUVIMEDOpdag EUVIMED
Crossref

Robot-mediated haptic feedback outperforms vision in violin duo coordination

Aleksandra Michałko iD, Francesco Di Tommaso iD, Emanuele Peperoni iD, Stefano L Capitani iD, Alessia Noccaro iD, Andrea Parri iD, Canan Gener iD, Roberto Conti iD, Nicola Di Stefano iD, Nevio Luigi Tagliamonte, Lorenzo Grazi iD, Francesco Giovacchini iD and 5 more

Science Robotics · 2026

DOI: 10.1126/scirobotics.aeb1901 ↗

At a glance

Journal article in Science Robotics, 2026. Written by Aleksandra Michałko and 16 co-authors. Institution: Faculty of Arts and Philosophy, IPEM Institute of Psychoacoustics and Electronic Music, Ghent University, Ghent, Belgium. Major MEDLINE topics: Robotics, Music, Feedback, Sensory, Haptic Interfaces. Cited 1 times so far (Crossref); 104 references. Funded by: European Commission, Flemish Government.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Joint actions among humans rely on the integration of multiple sensory modalities, most notably auditory and visual cues, which support explicit communication between partners. However, haptic feedback provides a direct, implicit channel for sensorimotor communication, and its contribution to fine motor coordination in joint actions remains largely unexplored. Here, we demonstrate that haptic communication, rendered through bidirectionally coupled wearable robots, outperforms traditional auditory-visual feedback in a complex and challenging real-life joint action: ensemble violin performance. First, we developed a pair of two–degree-of-freedom upper-limb exoskeletons capable of transparently following violinists’ natural movements and rendering viscoelastic torques proportional to the joint angular deviation between the partners. Then, we designed a within-subject experiment with 20 violin duos performing a musical piece under four sensory feedback conditions: auditory (A), auditory-visual (AV), auditory-haptic (AH), and auditory-visual-haptic (AVH), across two tempi (72 and 100 beats per minute). Despite the musicians being unfamiliar with the robot-mediated haptic feedback and unaware of the bidirectional connection between them, haptic feedback (AH and AVH) substantially enhanced spatiotemporal coordination and dynamic musical alignment compared with the extensively trained auditory-visual feedback (A and AV). The multisensory feedback condition AVH yielded the highest scores across all measures. Our findings demonstrate that haptic feedback can support fine motor coordination in violin duo performance more effectively than visual cues, particularly for professional musicians, because of its implicit and embodied nature, and that it can be effectively delivered via wearable robots, expanding the paradigms of human-human sensorimotor interactions.

Subjects

MeSH terms (MEDLINE)

RoboticsMusicFeedback, SensoryHaptic InterfacesHaptic TechnologyHumansMalePsychomotor PerformanceAdultFemaleYoung AdultVisual PerceptionCuesEquipment Design

Authors and institutions

  • Faculty of Arts and Philosophy, IPEM Institute of Psychoacoustics and Electronic Music, Ghent University, Ghent, Belgium.
  • Research Unit of Advanced Robotics and Human-Centred Technologies, Università Campus Bio-Medico di Roma, Rome, Italy.
  • BioRobotics Institute, Scuola Superiore Sant'Anna, Pontedera, Italy.
  • Neurorobotics Lab, School of Engineering, Newcastle University, Newcastle upon Tyne, UK.
  • IUVO S.r.l, Pontedera, Italy.
  • Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy.

ORCID profiles: Aleksandra Michałko, Francesco Di Tommaso, Emanuele Peperoni, Stefano L Capitani, Alessia Noccaro, Andrea Parri, Canan Gener, Roberto Conti, Nicola Di Stefano, Lorenzo Grazi, Francesco Giovacchini, Simona Crea, Emilio Trigili, Nicola Vitiello, Marc Leman, Domenico Formica

Funding

  • European Commission
  • Flemish Government

Cite

APA

Michałko, A., Di Tommaso, F., Peperoni, E., Capitani, S. L., Noccaro, A., Parri, A., Gener, C., Conti, R., Di Stefano, N., Tagliamonte, N. L., Grazi, L., Giovacchini, F., Crea, S., Trigili, E., Vitiello, N., Leman, M., & Formica, D. (2026). Robot-mediated haptic feedback outperforms vision in violin duo coordination. Science Robotics. https://doi.org/10.1126/scirobotics.aeb1901

Vancouver

Michałko A, Di Tommaso F, Peperoni E, Capitani SL, Noccaro A, Parri A, et al. Robot-mediated haptic feedback outperforms vision in violin duo coordination. Science Robotics. 2026. doi:10.1126/scirobotics.aeb1901

BibTeX
@article{Michako2026,
  author = {Michałko, Aleksandra and Di Tommaso, Francesco and Peperoni, Emanuele and Capitani, Stefano L and Noccaro, Alessia and Parri, Andrea and Gener, Canan and Conti, Roberto and Di Stefano, Nicola and Tagliamonte, Nevio Luigi and Grazi, Lorenzo and Giovacchini, Francesco and Crea, Simona and Trigili, Emilio and Vitiello, Nicola and Leman, Marc and Formica, Domenico},
  title = {Robot-mediated haptic feedback outperforms vision in violin duo coordination},
  journal = {Science Robotics},
  year = {2026},
  doi = {10.1126/scirobotics.aeb1901}
}
Start for free →