EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Type-2 Neutrosophic Markov Chain Model for Subject-Independent Sign Language Recognition: A New Uncertainty–Aware Soft Sensor Paradigm

Muslem Al-Saidi iD, Áron Ballagi, Oday Ali Hassen, Saad M Saad iD

Sensors · 2024

DOI: 10.3390/s24237828 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Muslem Al-Saidi und 3 weiteren Autor:innen. Beteiligte Einrichtung: Doctoral School of Multidisciplinary Engineering Sciences, Széchenyi István University, Egyetem tér 1, 9026 Gyor, Hungary. Hauptthemen laut MEDLINE: Markov Chains, Sign Language. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Uncertainty-aware soft sensors in sign language recognition (SLR) integrate methods to quantify and manage the uncertainty in their predictions. This is particularly crucial in SLR due to the variability in sign language gestures and differences in individual signing styles. Managing uncertainty allows the system to handle variations in signing styles, lighting conditions, and occlusions more effectively. While current techniques for handling uncertainty in SLR systems offer significant benefits in terms of improved accuracy and robustness, they also come with notable disadvantages. High computational complexity, data dependency, scalability issues, sensor and environmental limitations, and real-time constraints all pose significant hurdles. The aim of the work is to develop and evaluate a Type-2 Neutrosophic Hidden Markov Model (HMM) for SLR that leverages the advanced uncertainty handling capabilities of Type-2 neutrosophic sets. In the suggested soft sensor model, the Foot of Uncertainty (FOU) allows Type-2 Neutrosophic HMMs to represent uncertainty as intervals, capturing the range of possible values for truth, falsity, and indeterminacy. This is especially useful in SLR, where gestures can be ambiguous or imprecise. This enhances the model’s ability to manage complex uncertainties in sign language gestures and mitigate issues related to model drift. The FOU provides a measure of confidence for each recognition result by indicating the range of uncertainty. By effectively addressing uncertainty and enhancing subject independence, the model can be integrated into real-life applications, improving interactions, learning, and accessibility for the hearing-impaired. Examples such as assistive devices, educational tools, and customer service automation highlight its transformative potential. The experimental evaluation demonstrates the superiority of the Type-2 Neutrosophic HMM over the Type-1 Neutrosophic HMM in terms of accuracy for SLR. Specifically, the Type-2 Neutrosophic HMM consistently outperforms its Type-1 counterpart across various test scenarios, achieving an average accuracy improvement of 10%.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Markov ChainsSign LanguageHumansUncertaintyGesturesAlgorithmsPattern Recognition, Automated

Stichwörter der Autor:innen

Type-2 Neutrosophic reasoninghidden Markov modelsign language recognitionuncertainty-aware soft sensor

Autor:innen und Institutionen

  • Doctoral School of Multidisciplinary Engineering Sciences, Széchenyi István University, Egyetem tér 1, 9026 Gyor, Hungary.
  • Department of Automation, Széchenyi István University, Egyetem tér 1, 9026 Gyor, Hungary.
  • Ministry of Education, Wasit Education Directorate, Kut 52001, Iraq.
  • Department of Information Technology, Institute of Graduate Studies and Research, Alexandria University, Alexandria 21526, Egypt.
  • Department of Artificial Intelligence, Faculty of Computer Sciences and Artificial Intelligence, Pharos University in Alexandria, Canal El Mahmoudia Street, Beside Green Plaza, Alexandria 21648, Egypt.

ORCID-Profile: Muslem Al-Saidi, Saad M Saad

Zitieren

APA

Al-Saidi, M., Ballagi, Á., Hassen, O. A., & Saad, S. M. (2024). Type-2 Neutrosophic Markov Chain Model for Subject-Independent Sign Language Recognition: A New Uncertainty–Aware Soft Sensor Paradigm. Sensors. https://doi.org/10.3390/s24237828

Vancouver

Al-Saidi M, Ballagi Á, Hassen OA, Saad SM. Type-2 Neutrosophic Markov Chain Model for Subject-Independent Sign Language Recognition: A New Uncertainty–Aware Soft Sensor Paradigm. Sensors. 2024. doi:10.3390/s24237828

BibTeX
@article{AlSaidi2024,
  author = {Al-Saidi, Muslem and Ballagi, Áron and Hassen, Oday Ali and Saad, Saad M},
  title = {Type-2 Neutrosophic Markov Chain Model for Subject-Independent Sign Language Recognition: A New Uncertainty–Aware Soft Sensor Paradigm},
  journal = {Sensors},
  year = {2024},
  doi = {10.3390/s24237828}
}
Kostenlos starten →