EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Wearable high-density EMG sleeve for complex hand gesture classification and continuous joint angle estimation

Nicholas Tacca, Collin Dunlap, Sean P Donegan, James O Hardin, Eric Meyers, Michael J Darrow, Samuel Colachis Iv, Andrew Gillman, David A Friedenberg

Scientific Reports · 09.08.2024 · 14 (1)

DOI: 10.1038/s41598-024-64458-x ↗

Kurz gefasst

Fachartikel in der Zeitschrift Scientific Reports, online erschienen am 09.08.2024. Verfasst von Nicholas Tacca und 8 weiteren Autor:innen. Beteiligte Einrichtung: Battelle Memorial Institute, Neurotechnology, Columbus, OH, USA. tacca@battelle.org. Hauptthemen laut MEDLINE: Electromyography, Gestures, Wearable Electronic Devices, Hand. Die Arbeit wurde bisher 46-mal zitiert (Crossref) und nennt 116 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Battelle, Air Force Research Laboratory.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

High-density electromyography (HD-EMG) can provide a natural interface to enhance human–computer interaction (HCI). This study aims to demonstrate the capability of a novel HD-EMG forearm sleeve equipped with up to 150 electrodes to capture high-resolution muscle activity, decode complex hand gestures, and estimate continuous hand position via joint angle predictions. Ten able-bodied participants performed 37 hand movements and grasps while EMG was recorded using the HD-EMG sleeve. Simultaneously, an 18-sensor motion capture glove calculated 23 joint angles from the hand and fingers across all movements for training regression models. For classifying across the 37 gestures, our decoding algorithm was able to differentiate between sequential movements with $$97.3 \pm 0.3\%$$ 97.3 ± 0.3 % accuracy calculated on a 100 ms bin-by-bin basis. In a separate mixed dataset consisting of 19 movements randomly interspersed, decoding performance achieved an average bin-wise accuracy of $$92.8 \pm 0.8\%$$ 92.8 ± 0.8 % . When evaluating decoders for use in real-time scenarios, we found that decoders can reliably decode both movements and movement transitions, achieving an average accuracy of $$93.3 \pm 0.9\%$$ 93.3 ± 0.9 % on the sequential set and $$88.5 \pm 0.9\%$$ 88.5 ± 0.9 % on the mixed set. Furthermore, we estimated continuous joint angles from the EMG sleeve data, achieving a $$R^2$$ R 2 of $$0.884 \pm 0.003$$ 0.884 ± 0.003 in the sequential set and $$0.750 \pm 0.008$$ 0.750 ± 0.008 in the mixed set. Median absolute error (MAE) was kept below 10° across all joints, with a grand average MAE of $$1.8 \pm 0.04^\circ$$ 1.8 ± 0 . 04 ∘ and $$3.4 \pm 0.07^\circ$$ 3.4 ± 0 . 07 ∘ for the sequential and mixed datasets, respectively. We also assessed two algorithm modifications to address specific challenges for EMG-driven HCI applications. To minimize decoder latency, we used a method that accounts for reaction time by dynamically shifting cue labels in time. To reduce training requirements, we show that pretraining models with historical data provided an increase in decoding performance compared with models that were not pretrained when reducing the in-session training data to only one attempt of each movement. The HD-EMG sleeve, combined with sophisticated machine learning algorithms, can be a powerful tool for hand gesture recognition and joint angle estimation. This technology holds significant promise for applications in HCI, such as prosthetics, assistive technology, rehabilitation, and human–robot collaboration.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

ElectromyographyGesturesWearable Electronic DevicesHandHumansMaleFemaleAdultAlgorithmsMovementYoung Adult

Stichwörter der Autor:innen

Electromyography (EMG)Human–robot collaborationMachine learningWearables

Autor:innen und Institutionen

  • Battelle Memorial Institute, Neurotechnology, Columbus, OH, USA. tacca@battelle.org.
  • Battelle Memorial Institute, Neurotechnology, Columbus, OH, USA.
  • Air Force Research Laboratory, Materials And Manufacturing Directorate, Wright-Patterson AFB, OH, USA.

Förderung

  • Battelle
  • Air Force Research Laboratory

Zitieren

APA

Tacca, N., Dunlap, C., Donegan, S. P., Hardin, J. O., Meyers, E., Darrow, M. J., Colachis Iv, S., Gillman, A., & Friedenberg, D. A. (2024). Wearable high-density EMG sleeve for complex hand gesture classification and continuous joint angle estimation. Scientific Reports, 14(1). https://doi.org/10.1038/s41598-024-64458-x

Vancouver

Tacca N, Dunlap C, Donegan SP, Hardin JO, Meyers E, Darrow MJ, et al. Wearable high-density EMG sleeve for complex hand gesture classification and continuous joint angle estimation. Scientific Reports. 2024;14(1). doi:10.1038/s41598-024-64458-x

BibTeX
@article{Tacca2024,
  author = {Tacca, Nicholas and Dunlap, Collin and Donegan, Sean P and Hardin, James O and Meyers, Eric and Darrow, Michael J and Colachis Iv, Samuel and Gillman, Andrew and Friedenberg, David A},
  title = {Wearable high-density EMG sleeve for complex hand gesture classification and continuous joint angle estimation},
  journal = {Scientific Reports},
  year = {2024},
  volume = {14},
  number = {1},
  doi = {10.1038/s41598-024-64458-x}
}
Kostenlos starten →