EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Vocal-Eyes: AI-Powered Smart Glasses for the Blind Using Transformer-Based Architecture and Scene Graph Generation

Amna Shabbir, Uzma Afsheen, Muhammad Faizan Shirazi, Abdul Rauf, Syed Muhammad Meesam Abbas, Shahid Saeed, Abdul Samad Khan, Safdar Rizvi, Nurashikin Saaludin

Technologies · 24.06.2026 · 14 (7) · 384

DOI: 10.3390/technologies14070384 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Technologies, online erschienen am 24.06.2026. Verfasst von Amna Shabbir und 8 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 19 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visually impaired individuals face significant challenges in autonomous mobility and situational awareness. Most existing assistive technologies address isolated tasks, such as object recognition or text reading, while failing to capture broader environmental context. This work addresses this limitation by proposing a scene-sensitive, low-cost assistive system that delivers holistic situational information. We present Vocal-Eyes, an intelligent smart glasses platform that provides periodic audio descriptions of the surrounding environment. The system employs a cloud-based neural processing pipeline in which visual features are extracted using a Transformer-based architecture. Relational context is modeled through scene graph generation, and scene graphs are translated into natural language via a graph-to-text module. A lightweight hardware prototype captures visual data locally, while computationally intensive processing is offloaded to the cloud to reduce power consumption. The experimental results show that relational, scene-based narration produces more coherent and informative descriptions than object-centric approaches while maintaining acceptable periodic latency. Cost analysis further indicates that Vocal-Eyes is significantly more affordable than comparable commercial smart glasses solutions. These results demonstrate that Transformer-based scene understanding with cloud-assisted processing is an effective and practical approach for developing accessible, context-aware assistive technologies for visually impaired users.

Zitieren

APA

Shabbir, A., Afsheen, U., Shirazi, M. F., Rauf, A., Abbas, S. M. M., Saeed, S., Khan, A. S., Rizvi, S., & Saaludin, N. (2026). Vocal-Eyes: AI-Powered Smart Glasses for the Blind Using Transformer-Based Architecture and Scene Graph Generation. Technologies, 14(7), 384. https://doi.org/10.3390/technologies14070384

Vancouver

Shabbir A, Afsheen U, Shirazi MF, Rauf A, Abbas SMM, Saeed S, et al. Vocal-Eyes: AI-Powered Smart Glasses for the Blind Using Transformer-Based Architecture and Scene Graph Generation. Technologies. 2026;14(7):384. doi:10.3390/technologies14070384

BibTeX
@article{Shabbir2026,
  author = {Shabbir, Amna and Afsheen, Uzma and Shirazi, Muhammad Faizan and Rauf, Abdul and Abbas, Syed Muhammad Meesam and Saeed, Shahid and Khan, Abdul Samad and Rizvi, Safdar and Saaludin, Nurashikin},
  title = {Vocal-Eyes: AI-Powered Smart Glasses for the Blind Using Transformer-Based Architecture and Scene Graph Generation},
  journal = {Technologies},
  year = {2026},
  volume = {14},
  number = {7},
  pages = {384},
  doi = {10.3390/technologies14070384}
}
Kostenlos starten →