Class-specific data augmentation of an imbalanced dataset for signer-independent fingerspelling recognition
PeerJ Computer Science · 22.04.2026 · 12 · e3784
DOI: 10.7717/peerj-cs.3784 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 22.04.2026. Verfasst von Noraini Mohamed und 4 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Background
Signer-independent fingerspelling recognition (FSR) aims to convert hand configurations into text or speech while remaining robust to inter-signer variations. Although existing models perform well in signer-dependent settings, their accuracy drops significantly in signer-independent scenarios. A key challenge is dataset imbalance, including class imbalance and class-subject imbalance, where underrepresented classes or signer-specific samples contribute to misclassification, especially among visually similar handshapes.
Methods
This study proposed a class-specific data augmentation strategy to improve signer-independent FSR within the Massey dataset of static American Sign Language (ASL) images. To address class–subject imbalance, an initial brightness augmentation was applied, followed by targeted augmentation of frequently misclassified class groups (0, 2, 6, O, V, W, M, N, and T) to mitigate persistent misclassification patterns. A lightweight three-layer end-to-end convolutional neural network (CNN) was trained to extract discriminative spatial features across 36 alphanumeric classes. All experiments adopted a leave-one-subject-out cross-validation (LOSO-CV) to evaluate signer-independent recognition.
Results
The proposed strategy improved signer-independent FSR accuracy on the Massey dataset from a baseline of 83.60% to 88.22% through multiple class-specific augmentation techniques. This improvement was statistically significant ( p = 0.0198), indicating reduced misclassification among visually similar signs and improved robustness in a static-image signer-independent setting under constrained data conditions.
Zitieren
APA
Mohamed, N., Mustafa, M. B., Jomhari, N., Yusof, R. J. R., & Sani, A. A. (2026). Class-specific data augmentation of an imbalanced dataset for signer-independent fingerspelling recognition. PeerJ Computer Science, 12, e3784. https://doi.org/10.7717/peerj-cs.3784
Vancouver
Mohamed N, Mustafa MB, Jomhari N, Yusof RJR, Sani AA. Class-specific data augmentation of an imbalanced dataset for signer-independent fingerspelling recognition. PeerJ Computer Science. 2026;12:e3784. doi:10.7717/peerj-cs.3784
BibTeX
@article{Mohamed2026,
author = {Mohamed, Noraini and Mustafa, Mumtaz Begum and Jomhari, Nazean and Yusof, Raja Jamilah Raja and Sani, Asmiza Abdul},
title = {Class-specific data augmentation of an imbalanced dataset for signer-independent fingerspelling recognition},
journal = {PeerJ Computer Science},
year = {2026},
volume = {12},
pages = {e3784},
doi = {10.7717/peerj-cs.3784}
}
EUVIMED