EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Fusion of Attention-Based Convolution Neural Network and HOG Features for Static Sign Language Recognition

Diksha Kumari, Radhey Shyam Anand

Applied Sciences · 03.11.2023 · 13 (21) · 11993

DOI: 10.3390/app132111993 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 03.11.2023. Verfasst von Diksha Kumari und 1 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The deaf and hearing-impaired community expresses their emotions, communicates with society, and enhances the interaction between humans and computers using sign language gestures. This work presents a strategy for efficient feature extraction that uses a combination of two different methods that are the convolutional block attention module (CBAM)-based convolutional neural network (CNN) and standard handcrafted histogram of oriented gradients (HOG) feature descriptor. The proposed framework aims to enhance accuracy by extracting meaningful features and resolving issues like rotation, similar hand orientation, etc. The HOG feature extraction technique provides a compact feature representation that signifies meaningful information about sign gestures. The CBAM attention module is incorporated into the structure of CNN to enhance feature learning using spatial and channel attention mechanisms. Then, the final feature vector is formed by concatenating these features. This feature vector is provided to the classification layers to predict static sign gestures. The proposed approach is validated on two publicly available static Massey American Sign Language (ASL) and Indian Sign Language (ISL) databases. The model’s performance is evaluated using precision, recall, F1-score, and accuracy. Our proposed methodology achieved 99.22% and 99.79% accuracy for the ASL and ISL datasets. The acquired results signify the efficiency of the feature fusion and attention mechanism. Our network performed better in accuracy compared to the earlier studies.

Zitieren

APA

Kumari, D., & Anand, R. S. (2023). Fusion of Attention-Based Convolution Neural Network and HOG Features for Static Sign Language Recognition. Applied Sciences, 13(21), 11993. https://doi.org/10.3390/app132111993

Vancouver

Kumari D, Anand RS. Fusion of Attention-Based Convolution Neural Network and HOG Features for Static Sign Language Recognition. Applied Sciences. 2023;13(21):11993. doi:10.3390/app132111993

BibTeX
@article{Kumari2023,
  author = {Kumari, Diksha and Anand, Radhey Shyam},
  title = {Fusion of Attention-Based Convolution Neural Network and HOG Features for Static Sign Language Recognition},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {21},
  pages = {11993},
  doi = {10.3390/app132111993}
}
Kostenlos starten →