Error Action Recognition on Playing The Erhu Musical Instrument Using Hybrid Classification Method with 3D-CNN and LSTM
IJCCS (Indonesian Journal of Computing and Cybernetics Systems) · 31.07.2023 · 17 (3) · 313
DOI: 10.22146/ijccs.76555 ↗Kurz gefasst
Fachartikel in der Zeitschrift IJCCS (Indonesian Journal of Computing and Cybernetics Systems), online erschienen am 31.07.2023. Verfasst von Aditya Permana und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Erhu is a stringed instrument originating from China. In playing this instrument, there are rules on how to position the player's body and hold the instrument correctly. Therefore, a system is needed that can detect every movement of the Erhu player. This study will discuss action recognition on video using the 3DCNN and LSTM methods. The 3D Convolutional Neural Network method is a method that has a CNN base. To improve the ability to capture every information stored in every movement, combining an LSTM layer in the 3D-CNN model is necessary. LSTM is capable of handling the vanishing gradient problem faced by RNN. This research uses RGB video as a dataset, and there are three main parts in preprocessing and feature extraction. The three main parts are the body, erhu pole, and bow. To perform preprocessing and feature extraction, this study uses a body landmark to perform preprocessing and feature extraction on the body segment. In contrast, the erhu and bow segments use the Hough Lines algorithm. Furthermore, for the classification process, we propose two algorithms, namely, traditional algorithm and deep learning algorithm. These two-classification algorithms will produce an error message output from every movement of the erhu player.
Zitieren
APA
Permana, A., Shih, T. K., Musdholifah, A., & Sari, A. K. (2023). Error Action Recognition on Playing The Erhu Musical Instrument Using Hybrid Classification Method with 3D-CNN and LSTM. IJCCS (Indonesian Journal of Computing and Cybernetics Systems), 17(3), 313. https://doi.org/10.22146/ijccs.76555
Vancouver
Permana A, Shih TK, Musdholifah A, Sari AK. Error Action Recognition on Playing The Erhu Musical Instrument Using Hybrid Classification Method with 3D-CNN and LSTM. IJCCS (Indonesian Journal of Computing and Cybernetics Systems). 2023;17(3):313. doi:10.22146/ijccs.76555
BibTeX
@article{Permana2023,
author = {Permana, Aditya and Shih, Timothy K. and Musdholifah, Aina and Sari, Anny Kartika},
title = {Error Action Recognition on Playing The Erhu Musical Instrument Using Hybrid Classification Method with 3D-CNN and LSTM},
journal = {IJCCS (Indonesian Journal of Computing and Cybernetics Systems)},
year = {2023},
volume = {17},
number = {3},
pages = {313},
doi = {10.22146/ijccs.76555}
}
EUVIMED