Music, body, and machine: gesture-based synchronization in human-robot musical interaction
Frontiers in Robotics and AI · 05.12.2024 · 11
DOI: 10.3389/frobt.2024.1461615 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Robotics and AI, online erschienen am 05.12.2024. Verfasst von Xuedan Gao und 4 weiteren Autor:innen. Beteiligte Einrichtung: Robotic Musicianship Lab, Center for Music Technology, Georgia Institute of Technology, Atlanta, GA, United States. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Musical performance relies on nonverbal cues for conveying information among musicians. Human musicians use bodily gestures to communicate their interpretation and intentions to their collaborators, from mood and expression to anticipatory cues regarding structure and tempo. Robotic Musicians can use their physical bodies in a similar way when interacting with fellow musicians. The paper presents a new theoretical framework to classify musical gestures and a study evaluating the effect of robotic gestures on synchronization between human musicians and Shimon - a robotic marimba player developed at Georgia Tech. Shimon utilizes head and arm movements to signify musical information such as expected notes, tempo, and beat. The study, in which piano players were asked to play along with Shimon, assessed the effectiveness of these gestures on human-robot synchronization. Subjects were evaluated for their ability to synchronize with unknown tempo changes as communicated by Shimon’s ancillary and social gestures. The results demonstrate the significant contribution of non-instrumental gestures to human-robot synchronization, highlighting the importance of non-music-making gestures for anticipation and coordination in human-robot musical collaboration. Subjects also indicated more positive feelings when interacting with the robot’s ancillary and social gestures, indicating the role of these gestures in supporting engaging and enjoyable musical experiences.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Robotic Musicianship Lab, Center for Music Technology, Georgia Institute of Technology, Atlanta, GA, United States.
Zitieren
APA
Gao, X., Rogel, A., Sankaranarayanan, R., Dowling, B., & Weinberg, G. (2024). Music, body, and machine: gesture-based synchronization in human-robot musical interaction. Frontiers in Robotics and AI, 11. https://doi.org/10.3389/frobt.2024.1461615
Vancouver
Gao X, Rogel A, Sankaranarayanan R, Dowling B, Weinberg G. Music, body, and machine: gesture-based synchronization in human-robot musical interaction. Frontiers in Robotics and AI. 2024;11. doi:10.3389/frobt.2024.1461615
BibTeX
@article{Gao2024,
author = {Gao, Xuedan and Rogel, Amit and Sankaranarayanan, Raghavasimhan and Dowling, Brody and Weinberg, Gil},
title = {Music, body, and machine: gesture-based synchronization in human-robot musical interaction},
journal = {Frontiers in Robotics and AI},
year = {2024},
volume = {11},
doi = {10.3389/frobt.2024.1461615}
}
EUVIMED