EUVIMEDEUVIMED entdecken
Crossref

Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand

Chi-Jung Lee, Jiaxin Li, Tianhong Catherine Yu, Ruidong Zhang, Vipin Gunda, François Guimbretière, Cheng Zhang

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · 03.09.2025 · 9 (3) · 1-27

DOI: 10.1145/3749469 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, online erschienen am 03.09.2025. Verfasst von Chi-Jung Lee und 6 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 72 Literaturangaben. Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As computing devices become increasingly integrated into daily life, there is a growing need for intuitive, always-available interaction methods --- even when users' hands are occupied. In this paper, we introduce Grab-n-Go, the first wearable device that leverages active acoustic sensing to recognize subtle hand microgestures while holding various objects. Unlike prior systems that focus solely on free-hand gestures or basic hand-object activity recognition, Grab-n-Go simultaneously captures information about hand microgestures, grasping poses, and object geometries using a single wristband, enabling the recognition of fine-grained hand movements occurring within activities involving occupied hands. A deep learning framework processes these complex signals to identify 30 distinct microgestures, with 6 microgestures for each of the 5 grasping poses. In a user study with 10 participants and 25 everyday objects, Grab-n-Go achieved an average recognition accuracy of 92.0%. A follow-up study further validated Grab-n-Go's robustness against 10 more challenging, deformable objects. These results underscore the potential of Grab-n-Go to provide seamless, unobtrusive interactions without requiring modifications to existing objects. The complete dataset, comprising data from 18 participants performing 30 microgestures with 35 distinct objects, is publicly available at https://github.com/cjlisalee/Grab-n-Go_Data with the DOI: https://doi.org/10.7298/7kbd-vv75.

Förderung

  • National Science Foundation

Zitieren

APA

Lee, C., Li, J., Yu, T. C., Zhang, R., Gunda, V., Guimbretière, F., & Zhang, C. (2025). Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 9(3), 1-27. https://doi.org/10.1145/3749469

Vancouver

Lee C, Li J, Yu TC, Zhang R, Gunda V, Guimbretière F, et al. Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2025;9(3):1-27. doi:10.1145/3749469

BibTeX
@article{Lee2025,
  author = {Lee, Chi-Jung and Li, Jiaxin and Yu, Tianhong Catherine and Zhang, Ruidong and Gunda, Vipin and Guimbretière, François and Zhang, Cheng},
  title = {Grab-n-Go: On-the-Go Microgesture Recognition with Objects in Hand},
  journal = {Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies},
  year = {2025},
  volume = {9},
  number = {3},
  pages = {1--27},
  doi = {10.1145/3749469}
}
Kostenlos starten →