EUVIMEDEUVIMED entdecken
Crossref

Exploring visual directionality as a cross-modal cue in classical music

Johan Fröst, Kjetil Falkenberg

Arts & Communication · 20.11.2026 · 026130015

DOI: 10.36922/ac026130015 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Arts & Communication, online erschienen am 20.11.2026. Verfasst von Johan Fröst und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visual representations of music are widely used in notation, animation, and pedagogical tools, especially in video-based media. While various approaches have explored relationships between sound and visual phenomena, including color-based and synesthetic systems, relatively little work has examined how visualizations grounded in musically authentic elements, such as performers’ movements or instrument mechanics, might illuminate structural features of classical art music or support listeners’ understanding of complex textures. This raises the question of how visually grounded cues can be designed to make musical structure more perceptible, particularly for audiences with limited experience of classical repertoire. To address this, we investigated whether directional visual movement could mark musical phrases. We selected video segments whose motion aligned with phrase boundaries and determined how these movements should traverse the screen to convey progression and closure. Treating the design space as open, rather than assuming a single correct mapping, allowed us to explore alternative visual strategies empirically. We created paired visualizations based on excerpts from Claude Debussy’s Images (Books 1 and 2), whose richly layered textures provide an ecologically valid test case. In one version, visual gestures moved rightward at phrase onset and leftward at phrase end; in a flipped version, these directions were reversed. This enabled us to assess whether viewers shared directional expectations when interpreting musical motion and how they reasoned about links between movement and musical form. Although most excerpts produced no uniform preference, one passage elicited a clear directional choice among participants. These results suggest that carefully designed visual cues can highlight structural features in complex polytextural music, while remaining sensitive to local musical context.

Zitieren

APA

Fröst, J., & Falkenberg, K. (2026). Exploring visual directionality as a cross-modal cue in classical music. Arts & Communication, 0(0), 026130015. https://doi.org/10.36922/ac026130015

Vancouver

Fröst J, Falkenberg K. Exploring visual directionality as a cross-modal cue in classical music. Arts & Communication. 2026;0(0):026130015. doi:10.36922/ac026130015

BibTeX
@article{Frst2026,
  author = {Fröst, Johan and Falkenberg, Kjetil},
  title = {Exploring visual directionality as a cross-modal cue in classical music},
  journal = {Arts & Communication},
  year = {2026},
  volume = {0},
  number = {0},
  pages = {026130015},
  doi = {10.36922/ac026130015}
}
Kostenlos starten →