Auditory and tactile frequency mapping for visual distance perception: A step forward in sensory substitution and augmentation
PLOS ONE · 2025
DOI: 10.1371/journal.pone.0318354 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, 2025. Verfasst von Pingping Jiang und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Engineering Mathematics and Technology, University of Bristol, Bristol, United Kingdom. Hauptthemen laut MEDLINE: Auditory Perception, Distance Perception, Visual Perception, Touch Perception. Die Arbeit nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Vision is crucial for daily tasks and interacting with the environment, but visual impairment can hinder these activities. Many sensory substitution products and studies prioritize providing abundant and accurate information, yet often overlook the inherent relationship between different modalities, potentially preventing users from receiving information intuitively. This study investigated the representation of visual distance using auditory and vibrotactile frequency through a series of psychological cross-modal matching experiments. By establishing mapping functions between auditory/vibrotactile frequency and visual distance, we aim to facilitate the design of sensory substitution devices that take visual distance information (ranging from 1 m to 12 m) and convert it into non-visual information (auditory frequency within the range 47-2764 Hz or vibrotactile frequency within the range 10–99 Hz). Results show distinct patterns regarding the correlation between visual distance and frequency in both auditory (auditory frequency-to-visual distance) and vibrotactile (vibrotactile frequency-to-visual distance) domains. The prevailing trend (59%) was a monotonic negative correlation (i.e. higher frequencies are associated with shorter distances), while 24% of participants demonstrated a consistently positive correlation. Additionally, we compare this study with our previous investigations into the reverse cross-modal mapping of visual distance-to-auditory frequency and visual distance-to-vibrotactile frequency. We reveal common patterns between these two studies (negative and positive correlations), suggesting a bidirectional mapping between visual distance and frequency in both auditory and vibrotactile domains, and the potential for new sensory substitution devices for those with visual impairment by integrating underlying cross-modal mechanisms to enhance intuitive and natural human-machine interaction.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Engineering Mathematics and Technology, University of Bristol, Bristol, United Kingdom.
- SoftLab, Bristol Robotics Laboratory, Bristol, United Kingdom.
- School of Psychological Science, University of Bristol, Bristol, United Kingdom.
ORCID-Profile: Pingping Jiang
Zitieren
APA
Jiang, P., Rossiter, J., & Kent, C. (2025). Auditory and tactile frequency mapping for visual distance perception: A step forward in sensory substitution and augmentation. PLOS ONE. https://doi.org/10.1371/journal.pone.0318354
Vancouver
Jiang P, Rossiter J, Kent C. Auditory and tactile frequency mapping for visual distance perception: A step forward in sensory substitution and augmentation. PLOS ONE. 2025. doi:10.1371/journal.pone.0318354
BibTeX
@article{Jiang2025,
author = {Jiang, Pingping and Rossiter, Jonathan and Kent, Christopher},
title = {Auditory and tactile frequency mapping for visual distance perception: A step forward in sensory substitution and augmentation},
journal = {PLOS ONE},
year = {2025},
doi = {10.1371/journal.pone.0318354}
}
EUVIMED