EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Object Recognition System for the Visually Impaired: A Deep Learning Approach using Arabic Annotation

Nada Alzahrani, Heyam H. Al-Baity

Electronics · 20.01.2023 · 12 (3) · 541

DOI: 10.3390/electronics12030541 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 20.01.2023. Verfasst von Nada Alzahrani und 1 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Object detection is an important computer vision technique that has increasingly attracted the attention of researchers in recent years. The literature to date in the field has introduced a range of object detection models. However, these models have largely been English-language-based, and there is only a limited number of published studies that have addressed how object detection can be implemented for the Arabic language. As far as we are aware, the generation of an Arabic text-to-speech engine to utter objects’ names and their positions in images to help Arabic-speaking visually impaired people has not been investigated previously. Therefore, in this study, we propose an object detection and segmentation model based on the Mask R-CNN algorithm that is capable of identifying and locating different objects in images, then uttering their names and positions in Arabic. The proposed model was trained on the Pascal VOC 2007 and 2012 datasets and evaluated on the Pascal VOC 2007 testing set. We believe that this is one of a few studies that uses these datasets to train and test the Mask R-CNN model. The performance of the proposed object detection model was evaluated and compared with previous object detection models in the literature, and the results demonstrated its superiority and ability to achieve an accuracy of 83.9%. Moreover, experiments were conducted to evaluate the performance of the incorporated translator and TTS engines, and the results showed that the proposed model could be effective in helping Arabic-speaking visually impaired people understand the content of digital images.

Zitieren

APA

Alzahrani, N., & Al-Baity, H. H. (2023). Object Recognition System for the Visually Impaired: A Deep Learning Approach using Arabic Annotation. Electronics, 12(3), 541. https://doi.org/10.3390/electronics12030541

Vancouver

Alzahrani N, Al-Baity HH. Object Recognition System for the Visually Impaired: A Deep Learning Approach using Arabic Annotation. Electronics. 2023;12(3):541. doi:10.3390/electronics12030541

BibTeX
@article{Alzahrani2023,
  author = {Alzahrani, Nada and Al-Baity, Heyam H.},
  title = {Object Recognition System for the Visually Impaired: A Deep Learning Approach using Arabic Annotation},
  journal = {Electronics},
  year = {2023},
  volume = {12},
  number = {3},
  pages = {541},
  doi = {10.3390/electronics12030541}
}
Kostenlos starten →