Coordination dynamics in singing with human and artificial partners: the role of visual information
Frontiers in Cognition · 15.06.2026 · 5
DOI: 10.3389/fcogn.2026.1810330 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Cognition, online erschienen am 15.06.2026. Verfasst von Rina Nishiyama und 1 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Human Development and Environment, Kobe University, Kobe, Japan. Die Arbeit nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Science and Technology Agency.
Abstract (Originalsprache)
Introduction
This study examined whether coordination dynamics in singing differ when a person sings along with a human partner vs. an artificial partner generated by voice synthesis software (VOCALOID 6). We further investigated how the presence or absence of visual information shapes these coordination patterns.
Methods
Thirteen female participants sang a chorus excerpt of Silent Night in unison with a partner heard through earphones. The task crossed two partner types (a human singer and an artificial VOCALOID 6 singer) with two visual conditions (with and without partner video). Artificial-partner videos were created using an AI video platform (Hedra Character 3) that combined the artificial partner's synthesized voice with a still image of the human partner. Coordination was assessed through cross-correlation and Granger causality analyses of vocal amplitude envelopes, evaluated using linear mixed-effects models.
Results
Singing with a human partner elicited stronger anticipatory synchronization and greater similarity in amplitude envelopes than singing with an artificial partner. With the human partner, participants tended to sing slightly ahead of their partner, indicative of anticipatory coordination. Notably, this tendency was further strengthened when visual information was available.
Discussion
These findings indicate that the temporal variability of the human singing voice, together with the fine-grained bodily movements characteristic of naturalistic vocal production, provides perceptual information that supports anticipation and synchronization in joint singing.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Human Development and Environment, Kobe University, Kobe, Japan.
Förderung
- Japan Science and Technology Agency
Zitieren
APA
Nishiyama, R., & Nonaka, T. (2026). Coordination dynamics in singing with human and artificial partners: the role of visual information. Frontiers in Cognition, 5. https://doi.org/10.3389/fcogn.2026.1810330
Vancouver
Nishiyama R, Nonaka T. Coordination dynamics in singing with human and artificial partners: the role of visual information. Frontiers in Cognition. 2026;5. doi:10.3389/fcogn.2026.1810330
BibTeX
@article{Nishiyama2026,
author = {Nishiyama, Rina and Nonaka, Tetsushi},
title = {Coordination dynamics in singing with human and artificial partners: the role of visual information},
journal = {Frontiers in Cognition},
year = {2026},
volume = {5},
doi = {10.3389/fcogn.2026.1810330}
}
EUVIMED