EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Toward Injury-Prone Posture Recognition in Piano Practice via Multi-sensor Fusion and Deep Learning

Daniel Sheldon, Fangshi Zhou, Tianming Zhao, Zhongmei Yao

AI, Computer Science and Robotics Technology · 26.03.2026 · 5

DOI: 10.5772/acrt.20250080 ↗

Kurz gefasst

Fachartikel in der Zeitschrift AI, Computer Science and Robotics Technology, online erschienen am 26.03.2026. Verfasst von Daniel Sheldon und 3 weiteren Autor:innen. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Extended piano practice often prioritizes note and rhythm accuracy while overlooking the physical strain caused by inefficient movement. Over time, repeated poor technique can lead to chronic musculoskeletal injury. To address this, we present a multimodal, injury-aware gesture recognition framework designed to detect harmful gestures during piano performance. We introduce a novel dataset comprising 14 representative incorrect piano gestures, collected from 10 participants using a custom wearable prototype that integrates surface electromyography, inertial measurement units, and pressure sensors. To reduce label noise, gestures are performed in isolation. Using this dataset, we evaluate three deep learning architectures that take different approaches to multimodal data fusion and multi-label classification: (1) a parallel baseline with gesture-specific classifiers, (2) a backbone-based multi-head model, and (3) a prototype-based distance model trained with a composite loss. Experimental results show that the prototype-based model achieves the highest overall performance, with a precision of 0.97 and a recall of 0.70, significantly reducing false positives in gesture recognition. This work establishes a foundational, data-driven framework that paves the way for developing real-time, biomechanics-informed feedback systems to support healthier, injury-preventive piano practice.

Zitieren

APA

Sheldon, D., Zhou, F., Zhao, T., & Yao, Z. (2026). Toward Injury-Prone Posture Recognition in Piano Practice via Multi-sensor Fusion and Deep Learning. AI, Computer Science and Robotics Technology, 5. https://doi.org/10.5772/acrt.20250080

Vancouver

Sheldon D, Zhou F, Zhao T, Yao Z. Toward Injury-Prone Posture Recognition in Piano Practice via Multi-sensor Fusion and Deep Learning. AI, Computer Science and Robotics Technology. 2026;5. doi:10.5772/acrt.20250080

BibTeX
@article{Sheldon2026,
  author = {Sheldon, Daniel and Zhou, Fangshi and Zhao, Tianming and Yao, Zhongmei},
  title = {Toward Injury-Prone Posture Recognition in Piano Practice via Multi-sensor Fusion and Deep Learning},
  journal = {AI, Computer Science and Robotics Technology},
  year = {2026},
  volume = {5},
  doi = {10.5772/acrt.20250080}
}
Kostenlos starten →