Eye-Gaze Controlled Wheelchair Based on Deep Learning
Sensors · 07.07.2023 · 23 (13) · 6239
DOI: 10.3390/s23136239 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 07.07.2023. Verfasst von Jun Xu und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation, Harbin University of Science and Technology, Harbin 150080, China. Hauptthemen laut MEDLINE: Deep Learning, Wheelchairs. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Heilongjiang Provincial Education Department Scientific Research Fund Project.
Abstract (Originalsprache)
In this paper, we design a technologically intelligent wheelchair with eye-movement control for patients with ALS in a natural environment. The system consists of an electric wheelchair, a vision system, a two-dimensional robotic arm, and a main control system. The smart wheelchair obtains the eye image of the controller through a monocular camera and uses deep learning and an attention mechanism to calculate the eye-movement direction. In addition, starting from the relationship between the trajectory of the joystick and the wheelchair speed, we establish a motion acceleration model of the smart wheelchair, which reduces the sudden acceleration of the smart wheelchair during rapid motion and improves the smoothness of the motion of the smart wheelchair. The lightweight eye-movement recognition model is transplanted into an embedded AI controller. The test results show that the accuracy of eye-movement direction recognition is 98.49%, the wheelchair movement speed is up to 1 m/s, and the movement trajectory is smooth, without sudden changes.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Automation, Harbin University of Science and Technology, Harbin 150080, China.
- School of Electrical and Electronic Engineering, Harbin University of Science and Technology, Harbin 150080, China.
ORCID-Profile: Jun Xu
Förderung
- Heilongjiang Provincial Education Department Scientific Research Fund Project
Zitieren
APA
Xu, J., Huang, Z., Liu, L., Li, X., & Wei, K. (2023). Eye-Gaze Controlled Wheelchair Based on Deep Learning. Sensors, 23(13), 6239. https://doi.org/10.3390/s23136239
Vancouver
Xu J, Huang Z, Liu L, Li X, Wei K. Eye-Gaze Controlled Wheelchair Based on Deep Learning. Sensors. 2023;23(13):6239. doi:10.3390/s23136239
BibTeX
@article{Xu2023,
author = {Xu, Jun and Huang, Zuning and Liu, Liangyuan and Li, Xinghua and Wei, Kai},
title = {Eye-Gaze Controlled Wheelchair Based on Deep Learning},
journal = {Sensors},
year = {2023},
volume = {23},
number = {13},
pages = {6239},
doi = {10.3390/s23136239}
}
EUVIMED