Deep Learning-Based Eye-Writing Recognition with Improved Preprocessing and Data Augmentation Techniques
Sensors · 2025
DOI: 10.3390/s25206325 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Kota Suzuki und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu 965-8580, Fukushima, Japan. Hauptthemen laut MEDLINE: Deep Learning, Eye Movements, Eye-Tracking Technology. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Eye-tracking technology enables communication for individuals with muscle control difficulties, making it a valuable assistive tool. Traditional systems rely on electrooculography (EOG) or infrared devices, which are accurate but costly and invasive. While vision-based systems offer a more accessible alternative, they have not been extensively explored for eye-writing recognition. Additionally, the natural instability of eye movements and variations in writing styles result in inconsistent signal lengths, which reduces recognition accuracy and limits the practical use of eye-writing systems. To address these challenges, we propose a novel vision-based eye-writing recognition approach that utilizes a webcam-captured dataset. A key contribution of our approach is the introduction of a Discrete Fourier Transform (DFT)-based length normalization method that standardizes the length of each eye-writing sample while preserving essential spectral characteristics. This ensures uniformity in input lengths and improves both efficiency and robustness. Moreover, we integrate a hybrid deep learning model that combines 1D Convolutional Neural Networks (CNN) and Temporal Convolutional Networks (TCN) to jointly capture spatial and temporal features of eye-writing. To further improve model robustness, we incorporate data augmentation and initial-point normalization techniques. The proposed system was evaluated using our new webcam-captured Arabic numbers dataset and two existing benchmark datasets, with leave-one-subject-out (LOSO) cross-validation. The model achieved accuracies of 97.68% on the new dataset, 94.48% on the Japanese Katakana dataset, and 98.70% on the EOG-captured Arabic numbers dataset—outperforming existing systems. This work provides an efficient eye-writing recognition system, featuring robust preprocessing techniques, a hybrid deep learning model, and a new webcam-captured dataset.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Computer Science and Engineering, The University of Aizu, Aizuwakamatsu 965-8580, Fukushima, Japan.
ORCID-Profile: Kota Suzuki, Abu Saleh Musa Miah, Jungpil Shin
Zitieren
APA
Suzuki, K., Miah, A. S. M., & Shin, J. (2025). Deep Learning-Based Eye-Writing Recognition with Improved Preprocessing and Data Augmentation Techniques. Sensors. https://doi.org/10.3390/s25206325
Vancouver
Suzuki K, Miah ASM, Shin J. Deep Learning-Based Eye-Writing Recognition with Improved Preprocessing and Data Augmentation Techniques. Sensors. 2025. doi:10.3390/s25206325
BibTeX
@article{Suzuki2025,
author = {Suzuki, Kota and Miah, Abu Saleh Musa and Shin, Jungpil},
title = {Deep Learning-Based Eye-Writing Recognition with Improved Preprocessing and Data Augmentation Techniques},
journal = {Sensors},
year = {2025},
doi = {10.3390/s25206325}
}
EUVIMED