Exploring visual directionality as a cross-modal cue in classical music
Arts & Communication · 20.11.2026 · 026130015
DOI: 10.36922/ac026130015 ↗Kurz gefasst
Fachartikel in der Zeitschrift Arts & Communication, online erschienen am 20.11.2026. Verfasst von Johan Fröst und 1 weiteren Autor:innen.
Abstract (Originalsprache)
Visual representations of music are widely used in notation, animation, and pedagogical tools, especially in video-based media. While various approaches have explored relationships between sound and visual phenomena, including color-based and synesthetic systems, relatively little work has examined how visualizations grounded in musically authentic elements, such as performers’ movements or instrument mechanics, might illuminate structural features of classical art music or support listeners’ understanding of complex textures. This raises the question of how visually grounded cues can be designed to make musical structure more perceptible, particularly for audiences with limited experience of classical repertoire. To address this, we investigated whether directional visual movement could mark musical phrases. We selected video segments whose motion aligned with phrase boundaries and determined how these movements should traverse the screen to convey progression and closure. Treating the design space as open, rather than assuming a single correct mapping, allowed us to explore alternative visual strategies empirically. We created paired visualizations based on excerpts from Claude Debussy’s Images (Books 1 and 2), whose richly layered textures provide an ecologically valid test case. In one version, visual gestures moved rightward at phrase onset and leftward at phrase end; in a flipped version, these directions were reversed. This enabled us to assess whether viewers shared directional expectations when interpreting musical motion and how they reasoned about links between movement and musical form. Although most excerpts produced no uniform preference, one passage elicited a clear directional choice among participants. These results suggest that carefully designed visual cues can highlight structural features in complex polytextural music, while remaining sensitive to local musical context.
Zitieren
APA
Fröst, J., & Falkenberg, K. (2026). Exploring visual directionality as a cross-modal cue in classical music. Arts & Communication, 0(0), 026130015. https://doi.org/10.36922/ac026130015
Vancouver
Fröst J, Falkenberg K. Exploring visual directionality as a cross-modal cue in classical music. Arts & Communication. 2026;0(0):026130015. doi:10.36922/ac026130015
BibTeX
@article{Frst2026,
author = {Fröst, Johan and Falkenberg, Kjetil},
title = {Exploring visual directionality as a cross-modal cue in classical music},
journal = {Arts & Communication},
year = {2026},
volume = {0},
number = {0},
pages = {026130015},
doi = {10.36922/ac026130015}
}
EUVIMED