EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Gesture recognition algorithm based on multi‐scale feature fusion in RGB‐D images

Ying Sun, Yaoqing Weng, Bowen Luo, Gongfa Li, Bo Tao, Du Jiang, Disi Chen

IET Image Processing · 2023-03 · 17 (4) · 1280-1290

DOI: 10.1049/ipr2.12712 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Image Processing, online erschienen am 23.12.2022. Verfasst von Ying Sun und 6 weiteren Autor:innen. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the rapid development of sensor technology and artificial intelligence, the video gesture recognition technology under the background of big data makes human‐computer interaction more natural and flexible, bringing richer interactive experience to teaching, on‐board control, electronic games, etc. In order to perform robust recognition under the conditions of illumination change, background clutter, rapid movement, partial occlusion, an algorithm based on multi‐level feature fusion of two‐stream convolutional neural network is proposed, which includes three main steps. Firstly, the Kinect sensor obtains RGB‐D images to establish a gesture database. At the same time, data enhancement is performed on training and test sets. Then, a model of multi‐level feature fusion of two‐stream convolutional neural network is established and trained. Experiments result show that the proposed network model can robustly track and recognize gestures, and compared with the single‐channel model, the average detection accuracy is improved by 1.08%, and mean average precision (mAP) is improved by 3.56%. The average recognition rate of gestures under occlusion and different light intensity was 93.98%. Finally, in the ASL dataset, LaRED dataset, and 1‐miohand dataset, recognition accuracy shows satisfactory performances compared to the other method.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Sun, Y., Weng, Y., Luo, B., Li, G., Tao, B., Jiang, D., & Chen, D. (2023). Gesture recognition algorithm based on multi‐scale feature fusion in RGB‐D images. IET Image Processing, 17(4), 1280-1290. https://doi.org/10.1049/ipr2.12712

Vancouver

Sun Y, Weng Y, Luo B, Li G, Tao B, Jiang D, et al. Gesture recognition algorithm based on multi‐scale feature fusion in RGB‐D images. IET Image Processing. 2023;17(4):1280-1290. doi:10.1049/ipr2.12712

BibTeX
@article{Sun2023,
  author = {Sun, Ying and Weng, Yaoqing and Luo, Bowen and Li, Gongfa and Tao, Bo and Jiang, Du and Chen, Disi},
  title = {Gesture recognition algorithm based on multi‐scale feature fusion in RGB‐D images},
  journal = {IET Image Processing},
  year = {2023},
  volume = {17},
  number = {4},
  pages = {1280--1290},
  doi = {10.1049/ipr2.12712}
}
Kostenlos starten →