EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Eye-Gaze Controlled Wheelchair Based on Deep Learning

Jun Xu iD, Zuning Huang, Liangyuan Liu, Xinghua Li, Kai Wei

Sensors · 07.07.2023 · 23 (13) · 6239

DOI: 10.3390/s23136239 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 07.07.2023. Verfasst von Jun Xu und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Automation, Harbin University of Science and Technology, Harbin 150080, China. Hauptthemen laut MEDLINE: Deep Learning, Wheelchairs. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Heilongjiang Provincial Education Department Scientific Research Fund Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this paper, we design a technologically intelligent wheelchair with eye-movement control for patients with ALS in a natural environment. The system consists of an electric wheelchair, a vision system, a two-dimensional robotic arm, and a main control system. The smart wheelchair obtains the eye image of the controller through a monocular camera and uses deep learning and an attention mechanism to calculate the eye-movement direction. In addition, starting from the relationship between the trajectory of the joystick and the wheelchair speed, we establish a motion acceleration model of the smart wheelchair, which reduces the sudden acceleration of the smart wheelchair during rapid motion and improves the smoothness of the motion of the smart wheelchair. The lightweight eye-movement recognition model is transplanted into an embedded AI controller. The test results show that the accuracy of eye-movement direction recognition is 98.49%, the wheelchair movement speed is up to 1 m/s, and the movement trajectory is smooth, without sudden changes.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningWheelchairsHumansFixation, OcularMovementMotion

Stichwörter der Autor:innen

CBAM attentiondeep learningeye-trackingwheelchair acceleration model

Autor:innen und Institutionen

  • School of Automation, Harbin University of Science and Technology, Harbin 150080, China.
  • School of Electrical and Electronic Engineering, Harbin University of Science and Technology, Harbin 150080, China.

ORCID-Profile: Jun Xu

Förderung

  • Heilongjiang Provincial Education Department Scientific Research Fund Project

Zitieren

APA

Xu, J., Huang, Z., Liu, L., Li, X., & Wei, K. (2023). Eye-Gaze Controlled Wheelchair Based on Deep Learning. Sensors, 23(13), 6239. https://doi.org/10.3390/s23136239

Vancouver

Xu J, Huang Z, Liu L, Li X, Wei K. Eye-Gaze Controlled Wheelchair Based on Deep Learning. Sensors. 2023;23(13):6239. doi:10.3390/s23136239

BibTeX
@article{Xu2023,
  author = {Xu, Jun and Huang, Zuning and Liu, Liangyuan and Li, Xinghua and Wei, Kai},
  title = {Eye-Gaze Controlled Wheelchair Based on Deep Learning},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {13},
  pages = {6239},
  doi = {10.3390/s23136239}
}
Kostenlos starten →