EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Recognition of Arabic Air-Written Letters: Machine Learning, Convolutional Neural Networks, and Optical Character Recognition (OCR) Techniques

Khalid M O Nahar iD, Izzat Alsmadi iD, Rabia Emhamed Al Mamlook, Ahmad Nasayreh iD, Hasan Gharaibeh, Ali Saeed Almuflih iD, Fahad Alasim

Sensors · 28.11.2023 · 23 (23) · 9475

DOI: 10.3390/s23239475 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 28.11.2023. Verfasst von Khalid M O Nahar und 6 weiteren Autor:innen. Beteiligte Einrichtung: Computer Science Department, Faculty of Information Technology and Computer Sciences, Yarmouk University, Irbid 21163, Jordan. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: King Khalid University, the Deanship of Scientific Research, King Khalid University, Kingdom of Saudi Arabia.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Air writing is one of the essential fields that the world is turning to, which can benefit from the world of the metaverse, as well as the ease of communication between humans and machines. The research literature on air writing and its applications shows significant work in English and Chinese, while little research is conducted in other languages, such as Arabic. To fill this gap, we propose a hybrid model that combines feature extraction with deep learning models and then uses machine learning (ML) and optical character recognition (OCR) methods and applies grid and random search optimization algorithms to obtain the best model parameters and outcomes. Several machine learning methods (e.g., neural networks (NNs), random forest (RF), K-nearest neighbours (KNN), and support vector machine (SVM)) are applied to deep features extracted from deep convolutional neural networks (CNNs), such as VGG16, VGG19, and SqueezeNet. Our study uses the AHAWP dataset, which consists of diverse writing styles and hand sign variations, to train and evaluate the models. Prepossessing schemes are applied to improve data quality by reducing bias. Furthermore, OCR character (OCR) methods are integrated into our model to isolate individual letters from continuous air-written gestures and improve recognition results. The results of this study showed that the proposed model achieved the best accuracy of 88.8% using NN with VGG16.

Schlagwörter

Stichwörter der Autor:innen

Arabic air-writing recognitionOCRdeep learningmachine learningrecognition

Autor:innen und Institutionen

  • Computer Science Department, Faculty of Information Technology and Computer Sciences, Yarmouk University, Irbid 21163, Jordan.
  • Department of Computing and Cyber Security, Texas A&M University-San Antonio, San Antonio, TX 78224, USA.
  • Department of Business Administration, Trine University, Angola, IN 49008, USA.
  • Department of Mechanical and Industrial Engineering, University of Zawia, Tripoli 16418, Libya.
  • Department of Industrial Engineering, College of Engineering, King Khalid University, Abha 62529, Saudi Arabia.
  • Department of Industrial Engineering, College of Engineering, King Saud University, Riyadh 11495, Saudi Arabia.

ORCID-Profile: Khalid M O Nahar, Izzat Alsmadi, Ahmad Nasayreh, Ali Saeed Almuflih

Förderung

  • King Khalid University
  • the Deanship of Scientific Research, King Khalid University, Kingdom of Saudi Arabia

Zitieren

APA

Nahar, K. M. O., Alsmadi, I., Al Mamlook, R. E., Nasayreh, A., Gharaibeh, H., Almuflih, A. S., & Alasim, F. (2023). Recognition of Arabic Air-Written Letters: Machine Learning, Convolutional Neural Networks, and Optical Character Recognition (OCR) Techniques. Sensors, 23(23), 9475. https://doi.org/10.3390/s23239475

Vancouver

Nahar KMO, Alsmadi I, Al Mamlook RE, Nasayreh A, Gharaibeh H, Almuflih AS, et al. Recognition of Arabic Air-Written Letters: Machine Learning, Convolutional Neural Networks, and Optical Character Recognition (OCR) Techniques. Sensors. 2023;23(23):9475. doi:10.3390/s23239475

BibTeX
@article{Nahar2023,
  author = {Nahar, Khalid M O and Alsmadi, Izzat and Al Mamlook, Rabia Emhamed and Nasayreh, Ahmad and Gharaibeh, Hasan and Almuflih, Ali Saeed and Alasim, Fahad},
  title = {Recognition of Arabic Air-Written Letters: Machine Learning, Convolutional Neural Networks, and Optical Character Recognition (OCR) Techniques},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {23},
  pages = {9475},
  doi = {10.3390/s23239475}
}
Kostenlos starten →