FingerType: One-Handed Thumb-to-Finger Text Input Using 3D Hand Tracking
Sensors · 2026
DOI: 10.3390/s26030897 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2026. Verfasst von Nuo Jia und 4 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin Universi…. Hauptthemen laut MEDLINE: Fingers, Thumb. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Program of Science and Technology Development Plan of Jilin Province of China, Shenzhen Science and Technology Program.
Abstract (Originalsprache)
We present FingerType, a one-handed text input method based on thumb-to-finger gestures. FingerType detects tap events from 3D hand data using a Temporal Convolutional Network (TCN) and decodes the tap sequence into words with an n-gram language model. To inform the design, we examined thumb-to-finger interactions and collected comfort ratings of finger regions. We used these results to design an improved T9-style key layout. Our system runs at 72 frames per second and reaches 94.97% accuracy for tap detection. We conducted a six-block user study with 24 participants and compared FingerType with controller input and touch input. Entry speed increased from 5.88 WPM in the first practice block to 10.63 WPM in the final block. FingerType also supported more eyes-free typing: attention on the display panel within ±15° of head-gaze was 84.41%, higher than touch input (69.47%). Finally, we report error patterns and WPM learning curves, and a model-based analysis suggests improving gesture recognition accuracy could further increase speed and narrow the gap to traditional VR input methods.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun 130012, China.
- State Key Laboratory of Advanced Vehicle Integration and Control, China FAW Group Co., Ltd., Changchun 130013, China.
- School of Computer, Electronics and Information, Guangxi University, Nanning 530004, China.
- Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China.
ORCID-Profile: Nuo Jia, Minghui Sun
Förderung
- Program of Science and Technology Development Plan of Jilin Province of China
- Shenzhen Science and Technology Program
Zitieren
APA
Jia, N., Sun, M., Li, Y., Tian, Y., & Sun, T. (2026). FingerType: One-Handed Thumb-to-Finger Text Input Using 3D Hand Tracking. Sensors. https://doi.org/10.3390/s26030897
Vancouver
Jia N, Sun M, Li Y, Tian Y, Sun T. FingerType: One-Handed Thumb-to-Finger Text Input Using 3D Hand Tracking. Sensors. 2026. doi:10.3390/s26030897
BibTeX
@article{Jia2026,
author = {Jia, Nuo and Sun, Minghui and Li, Yan and Tian, Yang and Sun, Tao},
title = {FingerType: One-Handed Thumb-to-Finger Text Input Using 3D Hand Tracking},
journal = {Sensors},
year = {2026},
doi = {10.3390/s26030897}
}
EUVIMED