Walk Assist: An Integrated Arcore and Vision-Language Based Mobile Walking Assistance System For Blind And Low-Vision Pedestrians
Engineering and Technology Journal · 05.08.2026 · 11 (08)
DOI: 10.47191/etj/v11i08.02 ↗Kurz gefasst
Fachartikel in der Zeitschrift Engineering and Technology Journal, online erschienen am 05.08.2026. Verfasst von Seungjae Lee und 4 weiteren Autor:innen.
Abstract (Originalsprache)
This paper presents WalkAssist, an Android-based walking assistance system designed for blind and low-vision pedestrians. The system integrates ARCore spatial sensing, YOLO-based object segmentation, one-shot OCR, Gemini 2.5 Flash-Lite API scene description, map-based pedestrian route guidance, and multimodal feedback into a single mobile prototype. ARCore camera pose, hit tests, raw depth, and depth confidence are utilized to estimate the walking zone and nearby obstacle distance. YOLO26n-seg detects objects and provides segmentation masks, which are combined with depth samples to improve object-level distance awareness. OCR reads visible text when requested, while the Gemini 2.5 Flash-Lite API provides natural-language scene descriptions for additional context. The feedback layer delivers information through an on-screen overlay, text-to-speech, vibration, tones, and accessibility announcements. The implemented prototype demonstrates the feasibility of combining multiple perception and feedback modules on a smartphone to support pedestrian awareness. Development also revealed practical challenges, including ARCore depth instability, low-light sensitivity, and VLM latency, which were mitigated through confidence filtering, fallback depth sampling, output prioritization, and local walking-zone feedback prior to remote VLM responses.
Zitieren
APA
Lee, S., Jeon, S., Lee, S., Junho, Y., & Kwon, D. (2026). Walk Assist: An Integrated Arcore and Vision-Language Based Mobile Walking Assistance System For Blind And Low-Vision Pedestrians. Engineering and Technology Journal, 11(08). https://doi.org/10.47191/etj/v11i08.02
Vancouver
Lee S, Jeon S, Lee S, Junho Y, Kwon D. Walk Assist: An Integrated Arcore and Vision-Language Based Mobile Walking Assistance System For Blind And Low-Vision Pedestrians. Engineering and Technology Journal. 2026;11(08). doi:10.47191/etj/v11i08.02
BibTeX
@article{Lee2026,
author = {Lee, Seungjae and Jeon, Seonu and Lee, Seonkyu and Junho, Yeo and Kwon, Daehyun},
title = {Walk Assist: An Integrated Arcore and Vision-Language Based Mobile Walking Assistance System For Blind And Low-Vision Pedestrians},
journal = {Engineering and Technology Journal},
year = {2026},
volume = {11},
number = {08},
doi = {10.47191/etj/v11i08.02}
}
EUVIMED