EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Bilingual Sign Language Recognition: A YOLOv11-Based Model for Bangla and English Alphabets

Nawshin Navin iD, Fahmid Al Farid iD, Raiyen Z Rakin iD, Sadman S Tanzim, Mashrur Rahman, Shakila Rahman iD, Jia Uddin iD, Hezerul Abdul Karim iD

Journal of Imaging · 27.04.2025 · 11 (5) · 134

DOI: 10.3390/jimaging11050134 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 27.04.2025. Verfasst von Nawshin Navin und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, American International University-Bangladesh, Dhaka 1229, Bangladesh. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Multimedia University, Multimedia University, Cyberjaya, Selangor, Malaysia.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Communication through sign language effectively helps both hearing- and speaking-impaired individuals connect. However, there are problems with the interlingual communication between Bangla Sign Language (BdSL) and English Sign Language (ASL) due to the absence of a unified system. This study aims to introduce a detection system that incorporates these two sign languages to enhance the flow of communication for those who use these forms of sign language. This study developed and tested a deep learning-based sign-language detection system that can recognize both BdSL and ASL alphabets concurrently in real time. The approach uses a YOLOv11 object detection architecture that has been trained with an open-source dataset on a set of 9556 images containing 64 different letter signs from both languages. Data preprocessing was applied to enhance the performance of the model. Evaluation criteria, including the precision, recall, mAP, and other parameter values were also computed to evaluate the model. The performance analysis of the proposed method shows a precision of 99.12% and average recall rates of 99.63% in 30 epochs. The studies show that the proposed model outperforms the current techniques in sign language recognition (SLR) and can be used in communicating assistive technologies and human–computer interaction systems.

Schlagwörter

Stichwörter der Autor:innen

American Sign Language (ASL)Bangla Sign Language (BdSL)YOLOv11deep learningsign language recognition (SLR)

Autor:innen und Institutionen

  • Department of Computer Science, American International University-Bangladesh, Dhaka 1229, Bangladesh.
  • Centre for Image and Vision Computing (CIVC), COE for Artificial Intelligence, Faculty of Artificial Intelligence and Engineering (FAIE), Multimedia University, Cyberjaya 63100, Selangor, Malaysia.
  • AI and Big Data Department, Woosong University, Daejeon 34606, Republic of Korea.

ORCID-Profile: Nawshin Navin, Fahmid Al Farid, Raiyen Z Rakin, Shakila Rahman, Jia Uddin, Hezerul Abdul Karim

Förderung

  • Multimedia University
  • Multimedia University, Cyberjaya, Selangor, Malaysia

Zitieren

APA

Navin, N., Farid, F. A., Rakin, R. Z., Tanzim, S. S., Rahman, M., Rahman, S., Uddin, J., & Karim, H. A. (2025). Bilingual Sign Language Recognition: A YOLOv11-Based Model for Bangla and English Alphabets. Journal of Imaging, 11(5), 134. https://doi.org/10.3390/jimaging11050134

Vancouver

Navin N, Farid FA, Rakin RZ, Tanzim SS, Rahman M, Rahman S, et al. Bilingual Sign Language Recognition: A YOLOv11-Based Model for Bangla and English Alphabets. Journal of Imaging. 2025;11(5):134. doi:10.3390/jimaging11050134

BibTeX
@article{Navin2025,
  author = {Navin, Nawshin and Farid, Fahmid Al and Rakin, Raiyen Z and Tanzim, Sadman S and Rahman, Mashrur and Rahman, Shakila and Uddin, Jia and Karim, Hezerul Abdul},
  title = {Bilingual Sign Language Recognition: A YOLOv11-Based Model for Bangla and English Alphabets},
  journal = {Journal of Imaging},
  year = {2025},
  volume = {11},
  number = {5},
  pages = {134},
  doi = {10.3390/jimaging11050134}
}
Kostenlos starten →