EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Intelligent Eye-Controlled Electric Wheelchair Based on Estimating Visual Intentions Using One-Dimensional Convolutional Neural Network and Long Short-Term Memory

Sho Higa iD, Koji Yamada, Shihoko Kamisato

Sensors · 16.04.2023 · 23 (8) · 4028

DOI: 10.3390/s23084028 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 16.04.2023. Verfasst von Sho Higa und 2 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Engineering and Science, University of the Ryukyus, Nishihara 903-0213, Japan. Hauptthemen laut MEDLINE: Intention, Wheelchairs. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Japan Society for the Promotion of Science.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

When an electric wheelchair is operated using gaze motion, eye movements such as checking the environment and observing objects are also incorrectly recognized as input operations. This phenomenon is called the “Midas touch problem”, and classifying visual intentions is extremely important. In this paper, we develop a deep learning model that estimates the user’s visual intention in real time and an electric wheelchair control system that combines intention estimation and the gaze dwell time method. The proposed model consists of a 1DCNN-LSTM that estimates visual intention from feature vectors of 10 variables, such as eye movement, head movement, and distance to the fixation point. The evaluation experiments classifying four types of visual intentions show that the proposed model has the highest accuracy compared to other models. In addition, the results of the driving experiments of the electric wheelchair implementing the proposed model show that the user’s efforts to operate the wheelchair are reduced and that the operability of the wheelchair is improved compared to the traditional method. From these results, we concluded that visual intentions could be more accurately estimated by learning time series patterns from eye and head movement data.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

IntentionWheelchairsNeural Networks, ComputerEye Movements

Stichwörter der Autor:innen

electric wheelchaireye trackinghuman intention recognitionlong short-term memorymachine learningone-dimensional convolutional neural networkvisual intentions

Autor:innen und Institutionen

  • Graduate School of Engineering and Science, University of the Ryukyus, Nishihara 903-0213, Japan.
  • Department of Engineering, University of the Ryukyus, Nishihara 903-0213, Japan.
  • Department of Information and Communication Systems Engineering, National Institute of Technology, Okinawa College, Nago 905-2171, Japan.

ORCID-Profile: Sho Higa

Förderung

  • Japan Society for the Promotion of Science

Zitieren

APA

Higa, S., Yamada, K., & Kamisato, S. (2023). Intelligent Eye-Controlled Electric Wheelchair Based on Estimating Visual Intentions Using One-Dimensional Convolutional Neural Network and Long Short-Term Memory. Sensors, 23(8), 4028. https://doi.org/10.3390/s23084028

Vancouver

Higa S, Yamada K, Kamisato S. Intelligent Eye-Controlled Electric Wheelchair Based on Estimating Visual Intentions Using One-Dimensional Convolutional Neural Network and Long Short-Term Memory. Sensors. 2023;23(8):4028. doi:10.3390/s23084028

BibTeX
@article{Higa2023,
  author = {Higa, Sho and Yamada, Koji and Kamisato, Shihoko},
  title = {Intelligent Eye-Controlled Electric Wheelchair Based on Estimating Visual Intentions Using One-Dimensional Convolutional Neural Network and Long Short-Term Memory},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {8},
  pages = {4028},
  doi = {10.3390/s23084028}
}
Kostenlos starten →