EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Towards a unified terminology for sonification and visualization

Kajetan Enge iD, Alexander Rind iD, Michael Iber iD, Robert Höldrich iD, Wolfgang Aigner iD

Personal and Ubiquitous Computing · 2023-10 · 27 (5) · 1949-1963

DOI: 10.1007/s00779-023-01720-5 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Personal and Ubiquitous Computing, online erschienen am 21.08.2023. Verfasst von Kajetan Enge und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Creative Media Technologies, FH St. Pölten, Campusplatz 1, St. Pölten, 3100 Austria. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 86 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Gesellschaft für Forschungsförderung Niederösterreich, Austrian Science Fund.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Both sonification and visualization convey information about data by effectively using our human perceptual system, but their ways to transform the data differ. Over the past 30 years, the sonification community has demanded a holistic perspective on data representation, including audio-visual analysis, several times. A design theory of audio-visual analysis would be a relevant step in this direction. An indispensable foundation for this endeavor is a terminology describing the combined design space. To build a bridge between the domains, we adopt three of the established theoretical constructs from visualization theory for the field of sonification. The three constructs are the spatial substrate , the visual mark , and the visual channel . In our model, we choose time to be the temporal substrate of sonification. Auditory marks are then positioned in time, such as visual marks are positioned in space. Auditory channels are encoded into auditory marks to convey information. The proposed definitions allow discussing visualization and sonification designs as well as multi-modal designs based on a common terminology. While the identified terminology can support audio-visual analytics research, it also provides a new perspective on sonification theory itself.

Schlagwörter

Stichwörter der Autor:innen

Audio-visual data analysisSonification theoryVisualization theory

Autor:innen und Institutionen

  • Institute of Creative Media Technologies, FH St. Pölten, Campusplatz 1, St. Pölten, 3100 Austria.
  • Institute of Electronic Music and Acoustics, University of Music and Performing Arts Graz, Leonhardstraße 15, Graz, 8010 Austria.

ORCID-Profile: Kajetan Enge, Alexander Rind, Michael Iber, Robert Höldrich, Wolfgang Aigner

Förderung

  • Gesellschaft für Forschungsförderung Niederösterreich
  • Austrian Science Fund

Zitieren

APA

Enge, K., Rind, A., Iber, M., Höldrich, R., & Aigner, W. (2023). Towards a unified terminology for sonification and visualization. Personal and Ubiquitous Computing, 27(5), 1949-1963. https://doi.org/10.1007/s00779-023-01720-5

Vancouver

Enge K, Rind A, Iber M, Höldrich R, Aigner W. Towards a unified terminology for sonification and visualization. Personal and Ubiquitous Computing. 2023;27(5):1949-1963. doi:10.1007/s00779-023-01720-5

BibTeX
@article{Enge2023,
  author = {Enge, Kajetan and Rind, Alexander and Iber, Michael and Höldrich, Robert and Aigner, Wolfgang},
  title = {Towards a unified terminology for sonification and visualization},
  journal = {Personal and Ubiquitous Computing},
  year = {2023},
  volume = {27},
  number = {5},
  pages = {1949--1963},
  doi = {10.1007/s00779-023-01720-5}
}
Kostenlos starten →