EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Deep Learning-Based Eye-Writing Recognition with Improved Preprocessing and Data Augmentation Techniques

Kota Suzuki iD, Abu Saleh Musa Miah iD, Jungpil Shin iD

Sensors · 2025

DOI: 10.3390/s25206325 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Kota Suzuki und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu 965-8580, Fukushima, Japan. Hauptthemen laut MEDLINE: Deep Learning, Eye Movements, Eye-Tracking Technology. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Eye-tracking technology enables communication for individuals with muscle control difficulties, making it a valuable assistive tool. Traditional systems rely on electrooculography (EOG) or infrared devices, which are accurate but costly and invasive. While vision-based systems offer a more accessible alternative, they have not been extensively explored for eye-writing recognition. Additionally, the natural instability of eye movements and variations in writing styles result in inconsistent signal lengths, which reduces recognition accuracy and limits the practical use of eye-writing systems. To address these challenges, we propose a novel vision-based eye-writing recognition approach that utilizes a webcam-captured dataset. A key contribution of our approach is the introduction of a Discrete Fourier Transform (DFT)-based length normalization method that standardizes the length of each eye-writing sample while preserving essential spectral characteristics. This ensures uniformity in input lengths and improves both efficiency and robustness. Moreover, we integrate a hybrid deep learning model that combines 1D Convolutional Neural Networks (CNN) and Temporal Convolutional Networks (TCN) to jointly capture spatial and temporal features of eye-writing. To further improve model robustness, we incorporate data augmentation and initial-point normalization techniques. The proposed system was evaluated using our new webcam-captured Arabic numbers dataset and two existing benchmark datasets, with leave-one-subject-out (LOSO) cross-validation. The model achieved accuracies of 97.68% on the new dataset, 94.48% on the Japanese Katakana dataset, and 98.70% on the EOG-captured Arabic numbers dataset—outperforming existing systems. This work provides an efficient eye-writing recognition system, featuring robust preprocessing techniques, a hybrid deep learning model, and a new webcam-captured dataset.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningEye MovementsEye-Tracking TechnologyHumansNeural Networks, ComputerElectrooculographyAlgorithms

Stichwörter der Autor:innen

Convolutional Neural Network (CNN)Discrete Fourier Transform (DFT)Temporal Convolutional Network (TCN)character recognitioncomputer visiondeep learningeye-trackingeye-writingleave-one-subject-out cross-validationsignal normalization

Autor:innen und Institutionen

  • School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu 965-8580, Fukushima, Japan.

ORCID-Profile: Kota Suzuki, Abu Saleh Musa Miah, Jungpil Shin

Zitieren

APA

Suzuki, K., Miah, A. S. M., & Shin, J. (2025). Deep Learning-Based Eye-Writing Recognition with Improved Preprocessing and Data Augmentation Techniques. Sensors. https://doi.org/10.3390/s25206325

Vancouver

Suzuki K, Miah ASM, Shin J. Deep Learning-Based Eye-Writing Recognition with Improved Preprocessing and Data Augmentation Techniques. Sensors. 2025. doi:10.3390/s25206325

BibTeX
@article{Suzuki2025,
  author = {Suzuki, Kota and Miah, Abu Saleh Musa and Shin, Jungpil},
  title = {Deep Learning-Based Eye-Writing Recognition with Improved Preprocessing and Data Augmentation Techniques},
  journal = {Sensors},
  year = {2025},
  doi = {10.3390/s25206325}
}
Kostenlos starten →