EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Advancing disability-inclusive communication with DynaFuseNet and transformer models for sign language interpretation

Hooria Shahbaz, Armughan Ali, Abdullah Rashid, Salah Uddin Khan, Ibrahim Elbatal, Norma Latif Fitriyani, Yeonghyeon Gu, Muhammad Syafrudin

PeerJ Computer Science · 19.05.2026 · 12 · e3543

DOI: 10.7717/peerj-cs.3543 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 19.05.2026. Verfasst von Hooria Shahbaz und 7 weiteren Autor:innen. Die Arbeit nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Institute of Information & communications Technology Planning & Evaluation (IITP), Korea Government, The King Salman Center for Disability Research Funded this work through Research Group.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Fostering inclusion and overcoming accessibility barriers necessitates effective communication for individuals with disabilities. This study demonstrates the integration of Transformer models with a proposed deep learning architecture, DynaFuseNet, to interpret sign language. DynaFuseNet is a composite model that is capable of processing both static and dynamic sign representations. It is constructed by combining a FAST-SIFT Feature Fusion Framework (FSF 3 ) with a Dynamic Temporal Convolution Network (DTCN). The Transformer will enhance the system’s ability to capture long-range dependencies in temporal data, while the architecture employs multi-task learning to analyze various sign language structures simultaneously. To further enhance accessibility, the model will integrate natural language processing (NLP) techniques that would seamlessly translate sign languages. To ensure adaptability and inclusivity, rehabilitation centers have collaborated to create a comprehensive dataset that encompasses a range of regional sign languages and signing techniques. The WLASL dataset achieves 99.12% accuracy, while the MS-ASL dataset achieves 98.56% accuracy. The proposed system obtains state-of-the-art performance. The benefits of the DynaFuseNet architecture and its integration with Transformers in the pursuit of new frontiers in sign language recognition are evident in these results. Thus, this research substantiates the transformative potential of artificial intelligence (AI)-driven assistive technologies in fostering inclusive communication and empowering individuals with disabilities, thereby bridging the linguistic and accessibility disparities within and across diverse communities.

Förderung

  • Institute of Information & communications Technology Planning & Evaluation (IITP), Korea Government
  • The King Salman Center for Disability Research Funded this work through Research Group

Zitieren

APA

Shahbaz, H., Ali, A., Rashid, A., Khan, S. U., Elbatal, I., Fitriyani, N. L., Gu, Y., & Syafrudin, M. (2026). Advancing disability-inclusive communication with DynaFuseNet and transformer models for sign language interpretation. PeerJ Computer Science, 12, e3543. https://doi.org/10.7717/peerj-cs.3543

Vancouver

Shahbaz H, Ali A, Rashid A, Khan SU, Elbatal I, Fitriyani NL, et al. Advancing disability-inclusive communication with DynaFuseNet and transformer models for sign language interpretation. PeerJ Computer Science. 2026;12:e3543. doi:10.7717/peerj-cs.3543

BibTeX
@article{Shahbaz2026,
  author = {Shahbaz, Hooria and Ali, Armughan and Rashid, Abdullah and Khan, Salah Uddin and Elbatal, Ibrahim and Fitriyani, Norma Latif and Gu, Yeonghyeon and Syafrudin, Muhammad},
  title = {Advancing disability-inclusive communication with DynaFuseNet and transformer models for sign language interpretation},
  journal = {PeerJ Computer Science},
  year = {2026},
  volume = {12},
  pages = {e3543},
  doi = {10.7717/peerj-cs.3543}
}
Kostenlos starten →