EUVIMEDEUVIMED entdecken
ÜbersichtsarbeitOpen Access · CC BY 4.0

Hearing movement, seeing sound: multimodal predictive coding in pianist-dancer interaction

Xinyu Cao, Xinlei Shi

Frontiers in Psychology · 08.05.2026 · 17

DOI: 10.3389/fpsyg.2026.1820643 ↗

Kurz gefasst

Übersichtsarbeit in der Zeitschrift Frontiers in Psychology, online erschienen am 08.05.2026. Verfasst von Xinyu Cao und 1 weiteren Autor:innen. Beteiligte Einrichtung: Beihua University, Jilin, China. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Live piano accompaniment for dance poses a “zero-latency paradox”: performers achieve near-simultaneous audiovisual alignment despite sensory and integration delays that should make purely reactive control too slow. This review argues that pianist–dancer coordination can be usefully framed as bidirectional inference under cross-modal predictive coding, supported by converging behavioral, kinematic, and neurophysiological evidence. Motion-capture and time-series studies suggest that pianists can use dancers' preparatory kinematics, such as trajectory shifts and acceleration changes, to shorten the prediction window for timing and dynamics, while neuroimaging and EEG findings indicate action–perception coupling consistent with internal simulation of action–sound mappings (“seeing sound”). Sensorimotor synchronization paradigms show that micro-timing perturbations in auditory beats elicit rapid, asymmetric phase correction in stepping and tapping, consistent with predictive control in dancers (“hearing movement”), and autonomic measures further suggest that musical tension can modulate arousal before overt movement changes. Integrating coupled-oscillator modeling and EEG hyperscanning, we highlight quantifiable bidirectional adaptation and converging evidence that coordination is dynamically co-regulated rather than purely reactive or unidirectional. Taken together, the reviewed literature supports a neurally informed account of closed-loop dyadic coordination while also underscoring the need for more direct evidence from pianist–dancer interaction itself.

Schlagwörter

Stichwörter der Autor:innen

EEG hyperscanningactive inferencecoupled oscillator modeljoint actionmicro-timing perturbationpianist–dancer interactionpredictive codingsensorimotor synchronization

Autor:innen und Institutionen

  • Beihua University, Jilin, China.

Zitieren

APA

Cao, X., & Shi, X. (2026). Hearing movement, seeing sound: multimodal predictive coding in pianist-dancer interaction. Frontiers in Psychology, 17. https://doi.org/10.3389/fpsyg.2026.1820643

Vancouver

Cao X, Shi X. Hearing movement, seeing sound: multimodal predictive coding in pianist-dancer interaction. Frontiers in Psychology. 2026;17. doi:10.3389/fpsyg.2026.1820643

BibTeX
@article{Cao2026,
  author = {Cao, Xinyu and Shi, Xinlei},
  title = {Hearing movement, seeing sound: multimodal predictive coding in pianist-dancer interaction},
  journal = {Frontiers in Psychology},
  year = {2026},
  volume = {17},
  doi = {10.3389/fpsyg.2026.1820643}
}
Kostenlos starten →