Towards a unified terminology for sonification and visualization
Personal and Ubiquitous Computing · 2023-10 · 27 (5) · 1949-1963
DOI: 10.1007/s00779-023-01720-5 ↗Kurz gefasst
Fachartikel in der Zeitschrift Personal and Ubiquitous Computing, online erschienen am 21.08.2023. Verfasst von Kajetan Enge und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Creative Media Technologies, FH St. Pölten, Campusplatz 1, St. Pölten, 3100 Austria. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 86 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Gesellschaft für Forschungsförderung Niederösterreich, Austrian Science Fund.
Abstract (Originalsprache)
Both sonification and visualization convey information about data by effectively using our human perceptual system, but their ways to transform the data differ. Over the past 30 years, the sonification community has demanded a holistic perspective on data representation, including audio-visual analysis, several times. A design theory of audio-visual analysis would be a relevant step in this direction. An indispensable foundation for this endeavor is a terminology describing the combined design space. To build a bridge between the domains, we adopt three of the established theoretical constructs from visualization theory for the field of sonification. The three constructs are the spatial substrate , the visual mark , and the visual channel . In our model, we choose time to be the temporal substrate of sonification. Auditory marks are then positioned in time, such as visual marks are positioned in space. Auditory channels are encoded into auditory marks to convey information. The proposed definitions allow discussing visualization and sonification designs as well as multi-modal designs based on a common terminology. While the identified terminology can support audio-visual analytics research, it also provides a new perspective on sonification theory itself.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of Creative Media Technologies, FH St. Pölten, Campusplatz 1, St. Pölten, 3100 Austria.
- Institute of Electronic Music and Acoustics, University of Music and Performing Arts Graz, Leonhardstraße 15, Graz, 8010 Austria.
ORCID-Profile: Kajetan Enge, Alexander Rind, Michael Iber, Robert Höldrich, Wolfgang Aigner
Förderung
- Gesellschaft für Forschungsförderung Niederösterreich
- Austrian Science Fund
Zitieren
APA
Enge, K., Rind, A., Iber, M., Höldrich, R., & Aigner, W. (2023). Towards a unified terminology for sonification and visualization. Personal and Ubiquitous Computing, 27(5), 1949-1963. https://doi.org/10.1007/s00779-023-01720-5
Vancouver
Enge K, Rind A, Iber M, Höldrich R, Aigner W. Towards a unified terminology for sonification and visualization. Personal and Ubiquitous Computing. 2023;27(5):1949-1963. doi:10.1007/s00779-023-01720-5
BibTeX
@article{Enge2023,
author = {Enge, Kajetan and Rind, Alexander and Iber, Michael and Höldrich, Robert and Aigner, Wolfgang},
title = {Towards a unified terminology for sonification and visualization},
journal = {Personal and Ubiquitous Computing},
year = {2023},
volume = {27},
number = {5},
pages = {1949--1963},
doi = {10.1007/s00779-023-01720-5}
}
EUVIMED