EUVIMEDEUVIMED entdecken
Crossref

Detecting Hand Posture in Piano Playing Using Depth Data

David Johnson, Daniela Damian, George Tzanetakis

Computer Music Journal · 01.01.2019 · 43 (1) · 59-78

DOI: 10.1162/comj_a_00500 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Music Journal, online erschienen am 01.01.2019. Verfasst von David Johnson und 2 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref) und nennt 41 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present research for automatic assessment of pianist hand posture that is intended to help beginning piano students improve their piano-playing technique during practice sessions. To automatically assess a student's hand posture, we propose a system that is able to recognize three categories of postures from a single depth map containing a pianist's hands during performance. This is achieved through a computer vision pipeline that uses machine learning on the depth maps for both hand segmentation and detection of hand posture. First, we segment the left and right hands from the scene captured in the depth map using per-pixel classification. To train the hand-segmentation models, we experiment with two feature descriptors, depth image features and depth context features, that describe the context of individual pixels' neighborhoods. After the hands have been segmented from the depth map, a posture-detection model classifies each hand as one of three possible posture categories: correct posture, low wrists, or flat hands. Two methods are tested for extracting descriptors from the segmented hands, histograms of oriented gradients and histograms of normal vectors. To account for variation in hand size and practice space, detection models are individually built for each student using support vector machines with the extracted descriptors. We validate this approach using a data set that was collected by recording four beginning piano students while performing standard practice exercises. The results presented in this article show the effectiveness of this approach, with depth context features and histograms of normal vectors performing the best.

Zitieren

APA

Johnson, D., Damian, D., & Tzanetakis, G. (2019). Detecting Hand Posture in Piano Playing Using Depth Data. Computer Music Journal, 43(1), 59-78. https://doi.org/10.1162/comj_a_00500

Vancouver

Johnson D, Damian D, Tzanetakis G. Detecting Hand Posture in Piano Playing Using Depth Data. Computer Music Journal. 2019;43(1):59-78. doi:10.1162/comj_a_00500

BibTeX
@article{Johnson2019,
  author = {Johnson, David and Damian, Daniela and Tzanetakis, George},
  title = {Detecting Hand Posture in Piano Playing Using Depth Data},
  journal = {Computer Music Journal},
  year = {2019},
  volume = {43},
  number = {1},
  pages = {59--78},
  doi = {10.1162/comj_a_00500}
}
Kostenlos starten →