EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

CT-Net: A Hybrid ConvNeXt–Transformer Approach for ASL Alphabet Classification

Zhuofan Yang, Houjin Lu, Samaneh Shamshiri

Applied Sciences · 21.05.2026 · 16 (10) · 5168

DOI: 10.3390/app16105168 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 21.05.2026. Verfasst von Zhuofan Yang und 2 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recognition of the American Sign Language (ASL) alphabet is of utmost importance in bridging the communication gap between the hearing-impaired and the hearing. However, robust classification remains difficult because some hand gestures are morphologically very similar. To address this problem, this study presents CT-Net, a hybrid deep learning architecture that integrates ConvNeXt-Tiny with a lightweight Transformer encoder. CT-Net combines convolutional feature extraction and self-attention mechanisms, which enable it to capture fine-grained local patterns and long-range spatial dependencies effectively. The proposed model was extensively compared with various architectures including traditional CNNs, Transformer-based models, hybrid machine-learning approaches and recent lightweight hybrid networks. The experimental results show that CT-Net achieved the best overall performance with a peak accuracy of 95.67% on the enhanced ASL dataset. Ablation studies demonstrate the effectiveness of our design choice. CT-Net achieves a strong trade-off between recognition accuracy and computational efficiency with an inference rate of 163.55 Frames Per Second (FPS). These findings highlight the potential of hybrid frameworks as a powerful tool for fine-grained gesture recognition tasks.

Zitieren

APA

Yang, Z., Lu, H., & Shamshiri, S. (2026). CT-Net: A Hybrid ConvNeXt–Transformer Approach for ASL Alphabet Classification. Applied Sciences, 16(10), 5168. https://doi.org/10.3390/app16105168

Vancouver

Yang Z, Lu H, Shamshiri S. CT-Net: A Hybrid ConvNeXt–Transformer Approach for ASL Alphabet Classification. Applied Sciences. 2026;16(10):5168. doi:10.3390/app16105168

BibTeX
@article{Yang2026,
  author = {Yang, Zhuofan and Lu, Houjin and Shamshiri, Samaneh},
  title = {CT-Net: A Hybrid ConvNeXt–Transformer Approach for ASL Alphabet Classification},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {10},
  pages = {5168},
  doi = {10.3390/app16105168}
}
Kostenlos starten →