EUVIMEDEUVIMED entdecken
Crossref

Real-Time Audio Pattern Detection for Smart Musical Instruments

Nishal Silva, Luca Turchet

Journal of the Audio Engineering Society · 06.03.2026 · 74 (3) · 130-140

DOI: 10.17743/jaes.2022.0250 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the Audio Engineering Society, online erschienen am 06.03.2026. Verfasst von Nishal Silva und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents an algorithm for real-time polyphonic audio pattern detection designed to be integrated into smart musical instruments. Such instruments will enable musicians to use predefined musical patterns as triggers for external peripherals, such as stage lights, haptic wearables, and mixed reality headsets, during live performances. The paper first introduces a data set of polyphonic patterns containing musical patterns with expressive variations recorded by 20 musicians. Secondly, it presents an approach to classify audio segments in real time, consisting of a recurrent neural network architecture. Thirdly, it compares the proposed method against a traditional dynamic time warping approach as a benchmark. Results show that, although the benchmark achieves higher precision (0.8 versus 0.74), the proposed method yields a better overall performance, with an F1 score of 0.76 compared with 0.65. Most importantly, the proposed method exhibits a lower computational inference time (14 ms versus 1038 ms) and reduced CPU usage (31.36% versus 48.9%) when deployed on a Raspberry Pi 4. The low inference time meets the latency requirements necessary for real-time musical applications, and the system demonstrates the feasibility of embedded intelligence in musical instruments that can recognize polyphonic patterns with expressive variations during live performances.

Zitieren

APA

Silva, N., & Turchet, L. (2026). Real-Time Audio Pattern Detection for Smart Musical Instruments. Journal of the Audio Engineering Society, 74(3), 130-140. https://doi.org/10.17743/jaes.2022.0250

Vancouver

Silva N, Turchet L. Real-Time Audio Pattern Detection for Smart Musical Instruments. Journal of the Audio Engineering Society. 2026;74(3):130-140. doi:10.17743/jaes.2022.0250

BibTeX
@article{Silva2026,
  author = {Silva, Nishal and Turchet, Luca},
  title = {Real-Time Audio Pattern Detection for Smart Musical Instruments},
  journal = {Journal of the Audio Engineering Society},
  year = {2026},
  volume = {74},
  number = {3},
  pages = {130--140},
  doi = {10.17743/jaes.2022.0250}
}
Kostenlos starten →