Smart Drums: Comparing Audio and MIDI in Embedded Real-Time Drum Pattern Recognition
Journal of the Audio Engineering Society · 06.11.2026 · 74 (11) · 785-795
DOI: 10.17743/jaes.2026.0313 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the Audio Engineering Society, online erschienen am 06.11.2026. Verfasst von Nishal Silva und 1 weiteren Autor:innen.
Abstract (Originalsprache)
This paper compares dynamic time warping (DTW) and recurrent neural networks (RNNs) for real-time drum pattern recognition on embedded hardware using both MIDI and audio representations. Motivated by Smart Drums—electronic drum kits with embedded intelligence requiring low-latency, robust pattern detection to repurpose drum phrases as high-level control signals during live performances—a dataset was recorded from 20 drummers, comprising 200 distinct drum patterns, each with ten expressive variations (2,000 performance instances), recorded in MIDI and audio. DTW serves as an alignment-based baseline using pattern-specific thresholds applied to MIDI matrices and MFCC-based audio features. The RNN employs a stacked recurrent architecture trained on synthetic pattern variations generated by a rule-based model. Experiments assess accuracy (precision, recall, and F1-score), robustness to expressive variation, and embedded performance (latency, CPU, and RAM usage) on a Raspberry Pi 4 across sets of one, three, and ten simultaneous patterns. Results show that the RNN consistently attains higher F1-scores and lower inference times than DTW in both modalities, with the performance gap widening as the number of simultaneous patterns increases. While MIDI generally yields higher detection accuracy than audio, the RNN maintains robust performance in both domains, making it better suited for deployment on Smart Drums.
Zitieren
APA
Silva, N., & Turchet, L. (2026). Smart Drums: Comparing Audio and MIDI in Embedded Real-Time Drum Pattern Recognition. Journal of the Audio Engineering Society, 74(11), 785-795. https://doi.org/10.17743/jaes.2026.0313
Vancouver
Silva N, Turchet L. Smart Drums: Comparing Audio and MIDI in Embedded Real-Time Drum Pattern Recognition. Journal of the Audio Engineering Society. 2026;74(11):785-795. doi:10.17743/jaes.2026.0313
BibTeX
@article{Silva2026,
author = {Silva, Nishal and Turchet, Luca},
title = {Smart Drums: Comparing Audio and MIDI in Embedded Real-Time Drum Pattern Recognition},
journal = {Journal of the Audio Engineering Society},
year = {2026},
volume = {74},
number = {11},
pages = {785--795},
doi = {10.17743/jaes.2026.0313}
}
EUVIMED