EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Application of Image Processing for Sign Language Interpreter

Ng Thung Xeng, Hafizul Azizi bin Ismail, Yvette Shaan Li-Susiapan, Lau Chee Yong, Sathish Kumar Selva Perumal, Ittidej Moonmangmee

Electronic Journal of Business and Management · 01.05.2024 · 9 (S1) · 67-80

DOI: 10.65136/ejbm.v9is1.219 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronic Journal of Business and Management, online erschienen am 01.05.2024. Verfasst von Ng Thung Xeng und 5 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The aim of this research is to develop a sign language interpreting system that interprets and translates American Sign Language (ASL) into English words and sentences through machine vision and machine learning. In the proposed methodology, algorithms for data augmentation and data preprocessing as well as model training and evaluation are developed along with the system’s Graphical User Interphase (GUI). 3 different models are trained while developing the system, LSTM, Bi-LSTM and GRU and among them, GRU achieves the highest training accuracy of 95.14% and evaluation accuracy of 95.56% hence it is implemented into the system. By testing it in real-time, the system is able to make predictions in 0.143 seconds with 98.79% confidence. Through other various tests, the system proved its capability to produce equally accurate predictions in real-time regardless of the signer’s position, distance and hands used. The system is also able to translate ASL sentences intogrammatically sound English sentences through OpenAI API.

Zitieren

APA

Xeng, N. T., Ismail, H. A. B., Li-Susiapan, Y. S., Yong, L. C., Perumal, S. K. S., & Moonmangmee, I. (2024). Application of Image Processing for Sign Language Interpreter. Electronic Journal of Business and Management, 9(S1), 67-80. https://doi.org/10.65136/ejbm.v9is1.219

Vancouver

Xeng NT, Ismail HAB, Li-Susiapan YS, Yong LC, Perumal SKS, Moonmangmee I. Application of Image Processing for Sign Language Interpreter. Electronic Journal of Business and Management. 2024;9(S1):67-80. doi:10.65136/ejbm.v9is1.219

BibTeX
@article{Xeng2024,
  author = {Xeng, Ng Thung and Ismail, Hafizul Azizi bin and Li-Susiapan, Yvette Shaan and Yong, Lau Chee and Perumal, Sathish Kumar Selva and Moonmangmee, Ittidej},
  title = {Application of Image Processing for Sign Language Interpreter},
  journal = {Electronic Journal of Business and Management},
  year = {2024},
  volume = {9},
  number = {S1},
  pages = {67--80},
  doi = {10.65136/ejbm.v9is1.219}
}
Kostenlos starten →