Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People
Sensors · 2023
DOI: 10.3390/s23177616 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Takumi Asakura. Beteiligte Einrichtung: Department of Mechanical and Aerospace Engineering, Faculty of Science and Technology, Tokyo University of Science, Chiba 278-8510, Japan. Hauptthemen laut MEDLINE: Persons with Hearing Disabilities, Augmented Reality. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Normal-hearing people use sound as a cue to recognize various events that occur in their surrounding environment; however, this is not possible for deaf and hearing of hard (DHH) people, and in such a context they may not be able to freely detect their surrounding environment. Therefore, there is an opportunity to create a convenient device that can detect sounds occurring in daily life and present them visually instead of auditorily. Additionally, it is of great importance to appropriately evaluate how such a supporting device would change the lives of DHH people. The current study proposes an augmented-reality-based system for presenting household sounds to DHH people as visual information. We examined the effect of displaying both the icons indicating sounds classified by machine learning and a dynamic spectrogram indicating the real-time time–frequency characteristics of the environmental sounds. First, the issues that DHH people perceive as problems in their daily lives were investigated through a survey, suggesting that DHH people need to visualize their surrounding sound environment. Then, after the accuracy of the machine-learning-based classifier installed in the proposed system was validated, the subjective impression of how the proposed system increased the comfort of daily life was obtained through a field experiment in a real residence. The results confirmed that the comfort of daily life in household spaces can be improved by combining not only the classification results of machine learning but also the real-time display of spectrograms.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Mechanical and Aerospace Engineering, Faculty of Science and Technology, Tokyo University of Science, Chiba 278-8510, Japan.
ORCID-Profile: Takumi Asakura
Zitieren
APA
Asakura, T. (2023). Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People. Sensors. https://doi.org/10.3390/s23177616
Vancouver
Asakura T. Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People. Sensors. 2023. doi:10.3390/s23177616
BibTeX
@article{Asakura2023,
author = {Asakura, Takumi},
title = {Augmented-Reality Presentation of Household Sounds for Deaf and Hard-of-Hearing People},
journal = {Sensors},
year = {2023},
doi = {10.3390/s23177616}
}
EUVIMED