Toward Injury-Prone Posture Recognition in Piano Practice via Multi-sensor Fusion and Deep Learning
AI, Computer Science and Robotics Technology · 26.03.2026 · 5
DOI: 10.5772/acrt.20250080 ↗Kurz gefasst
Fachartikel in der Zeitschrift AI, Computer Science and Robotics Technology, online erschienen am 26.03.2026. Verfasst von Daniel Sheldon und 3 weiteren Autor:innen. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Extended piano practice often prioritizes note and rhythm accuracy while overlooking the physical strain caused by inefficient movement. Over time, repeated poor technique can lead to chronic musculoskeletal injury. To address this, we present a multimodal, injury-aware gesture recognition framework designed to detect harmful gestures during piano performance. We introduce a novel dataset comprising 14 representative incorrect piano gestures, collected from 10 participants using a custom wearable prototype that integrates surface electromyography, inertial measurement units, and pressure sensors. To reduce label noise, gestures are performed in isolation. Using this dataset, we evaluate three deep learning architectures that take different approaches to multimodal data fusion and multi-label classification: (1) a parallel baseline with gesture-specific classifiers, (2) a backbone-based multi-head model, and (3) a prototype-based distance model trained with a composite loss. Experimental results show that the prototype-based model achieves the highest overall performance, with a precision of 0.97 and a recall of 0.70, significantly reducing false positives in gesture recognition. This work establishes a foundational, data-driven framework that paves the way for developing real-time, biomechanics-informed feedback systems to support healthier, injury-preventive piano practice.
Zitieren
APA
Sheldon, D., Zhou, F., Zhao, T., & Yao, Z. (2026). Toward Injury-Prone Posture Recognition in Piano Practice via Multi-sensor Fusion and Deep Learning. AI, Computer Science and Robotics Technology, 5. https://doi.org/10.5772/acrt.20250080
Vancouver
Sheldon D, Zhou F, Zhao T, Yao Z. Toward Injury-Prone Posture Recognition in Piano Practice via Multi-sensor Fusion and Deep Learning. AI, Computer Science and Robotics Technology. 2026;5. doi:10.5772/acrt.20250080
BibTeX
@article{Sheldon2026,
author = {Sheldon, Daniel and Zhou, Fangshi and Zhao, Tianming and Yao, Zhongmei},
title = {Toward Injury-Prone Posture Recognition in Piano Practice via Multi-sensor Fusion and Deep Learning},
journal = {AI, Computer Science and Robotics Technology},
year = {2026},
volume = {5},
doi = {10.5772/acrt.20250080}
}
EUVIMED