EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

EchoSee: An Assistive Mobile Application for Real-Time 3D Environment Reconstruction and Sonification Supporting Enhanced Navigation for People with Vision Impairments

Broderick S Schwartz iD, Seth King iD, Tyler Bell iD

Bioengineering · 14.08.2024 · 11 (8) · 831

DOI: 10.3390/bioengineering11080831 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Bioengineering, online erschienen am 14.08.2024. Verfasst von Broderick S Schwartz und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical and Computer Engineering, College of Engineering, University of Iowa, Iowa City, IA 52242, USA. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 63 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: RRD VA, Department of Veterans Affairs, Veterans Health Administration, Rehabilitation Research and Development Service.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Improving the quality of life for people with vision impairments has been an important goal in the research and design of assistive devices for several decades. This paper seeks to further that goal by introducing a novel assistive technology platform that leverages real-time 3D spatial audio to promote safe and efficient navigation for people who are blind or visually impaired (PVI). The presented platform, EchoSee, uses modern 3D scanning technology on a mobile device to construct a live, digital 3D map of a user’s environment as they move about their surroundings. Spatialized, virtual audio sources (i.e., virtual speakers) are dynamically placed within the digital 3D scan of the world, providing the navigator with a real-time 3D stereo audio “soundscape.” The digital 3D map, and its resultant soundscape, are continuously updated as the user moves about their environment. The generated soundscape is played back through headphones connected to the navigator’s device. This paper details (1) the underlying technical components and how they were integrated to produce the mobile application that generates a dynamic soundscape on a consumer mobile device, (2) a methodology for analyzing navigation performance with the application, (3) the design and execution of a user study investigating the effectiveness of the presented system, and (4) a discussion of the results of that study along with a proposed future study and possible improvements. Altogether, this paper presents a novel software platform aimed at assisting individuals with vision impairments to navigate and understand spaces safely, efficiently, and independently and the results of a feasibility study analyzing the viability of the approach.

Schlagwörter

Stichwörter der Autor:innen

3D localization and mapping3D reconstructionassistive technologyhuman–computer interactionrehabilitationsensory substitutionspatial audio feedbackvisual impairment navigation

Autor:innen und Institutionen

  • Department of Electrical and Computer Engineering, College of Engineering, University of Iowa, Iowa City, IA 52242, USA.
  • Department of Teaching and Learning, College of Education, University of Iowa, Iowa City, IA 52242, USA.

ORCID-Profile: Broderick S Schwartz, Seth King, Tyler Bell

Förderung

  • RRD VA
  • Department of Veterans Affairs, Veterans Health Administration, Rehabilitation Research and Development Service

Zitieren

APA

Schwartz, B. S., King, S., & Bell, T. (2024). EchoSee: An Assistive Mobile Application for Real-Time 3D Environment Reconstruction and Sonification Supporting Enhanced Navigation for People with Vision Impairments. Bioengineering, 11(8), 831. https://doi.org/10.3390/bioengineering11080831

Vancouver

Schwartz BS, King S, Bell T. EchoSee: An Assistive Mobile Application for Real-Time 3D Environment Reconstruction and Sonification Supporting Enhanced Navigation for People with Vision Impairments. Bioengineering. 2024;11(8):831. doi:10.3390/bioengineering11080831

BibTeX
@article{Schwartz2024,
  author = {Schwartz, Broderick S and King, Seth and Bell, Tyler},
  title = {EchoSee: An Assistive Mobile Application for Real-Time 3D Environment Reconstruction and Sonification Supporting Enhanced Navigation for People with Vision Impairments},
  journal = {Bioengineering},
  year = {2024},
  volume = {11},
  number = {8},
  pages = {831},
  doi = {10.3390/bioengineering11080831}
}
Kostenlos starten →