EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

FingerType: One-Handed Thumb-to-Finger Text Input Using 3D Hand Tracking

Nuo Jia iD, Minghui Sun iD, Yan Li, Yang Tian, Tao Sun

Sensors · 2026

DOI: 10.3390/s26030897 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2026. Verfasst von Nuo Jia und 4 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin Universi…. Hauptthemen laut MEDLINE: Fingers, Thumb. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Program of Science and Technology Development Plan of Jilin Province of China, Shenzhen Science and Technology Program.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present FingerType, a one-handed text input method based on thumb-to-finger gestures. FingerType detects tap events from 3D hand data using a Temporal Convolutional Network (TCN) and decodes the tap sequence into words with an n-gram language model. To inform the design, we examined thumb-to-finger interactions and collected comfort ratings of finger regions. We used these results to design an improved T9-style key layout. Our system runs at 72 frames per second and reaches 94.97% accuracy for tap detection. We conducted a six-block user study with 24 participants and compared FingerType with controller input and touch input. Entry speed increased from 5.88 WPM in the first practice block to 10.63 WPM in the final block. FingerType also supported more eyes-free typing: attention on the display panel within ±15° of head-gaze was 84.41%, higher than touch input (69.47%). Finally, we report error patterns and WPM learning curves, and a model-based analysis suggests improving gesture recognition accuracy could further increase speed and narrow the gap to traditional VR input methods.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

FingersThumbHumansGesturesUser-Computer Interface

Stichwörter der Autor:innen

bare-hand inputmid-air inputone-handed interactiontext entrythumb-to-finger gesturesvirtual reality

Autor:innen und Institutionen

  • Key Laboratory of Symbolic Computation and Knowledge Engineering of Ministry of Education, College of Computer Science and Technology, Jilin University, Changchun 130012, China.
  • State Key Laboratory of Advanced Vehicle Integration and Control, China FAW Group Co., Ltd., Changchun 130013, China.
  • School of Computer, Electronics and Information, Guangxi University, Nanning 530004, China.
  • Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130033, China.

ORCID-Profile: Nuo Jia, Minghui Sun

Förderung

  • Program of Science and Technology Development Plan of Jilin Province of China
  • Shenzhen Science and Technology Program

Zitieren

APA

Jia, N., Sun, M., Li, Y., Tian, Y., & Sun, T. (2026). FingerType: One-Handed Thumb-to-Finger Text Input Using 3D Hand Tracking. Sensors. https://doi.org/10.3390/s26030897

Vancouver

Jia N, Sun M, Li Y, Tian Y, Sun T. FingerType: One-Handed Thumb-to-Finger Text Input Using 3D Hand Tracking. Sensors. 2026. doi:10.3390/s26030897

BibTeX
@article{Jia2026,
  author = {Jia, Nuo and Sun, Minghui and Li, Yan and Tian, Yang and Sun, Tao},
  title = {FingerType: One-Handed Thumb-to-Finger Text Input Using 3D Hand Tracking},
  journal = {Sensors},
  year = {2026},
  doi = {10.3390/s26030897}
}
Kostenlos starten →