EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Unsupervised Clustering and Ensemble Learning for Classifying Lip Articulation in Fingerspelling

Nurzada Amangeldy iD, Nazerke Gazizova iD, Marek Milosz iD, Bekbolat Kurmetbek iD, Aizhan Nazyrova iD, Akmaral Kassymova iD

Sensors · 2025

DOI: 10.3390/s25123703 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2025. Verfasst von Nurzada Amangeldy und 5 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Information Technologies, L.N. Gumilyov Eurasian National University, Astana 010008, Kazakhstan. Hauptthemen laut MEDLINE: Lip, Unsupervised Machine Learning, Fingers. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and Higher Education of the Republic of Kazakhstan, Ministry of Science and Higher Education.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a new methodology for analyzing lip articulation during fingerspelling aimed at extracting robust visual patterns that can overcome the inherent ambiguity and variability of lip shape. The proposed approach is based on unsupervised clustering of lip movement trajectories to identify consistent articulatory patterns across different time profiles. The methodology is not limited to using a single model. Still, it includes the exploration of varying cluster configurations and an assessment of their robustness, as well as a detailed analysis of the correspondence between individual alphabet letters and specific clusters. In contrast to direct classification based on raw visual features, this approach pre-tests clustered representations using a model-based assessment of their discriminative potential. This structured approach enhances the interpretability and robustness of the extracted features, highlighting the importance of lip dynamics as an auxiliary modality in multimodal sign language recognition. The obtained results demonstrate that trajectory clustering can serve as a practical method for generating features, providing more accurate and context-sensitive gesture interpretation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LipUnsupervised Machine LearningFingersHumansCluster AnalysisGesturesSign LanguageAlgorithmsEnsemble Learning

Stichwörter der Autor:innen

fingerspellinglip articulationmultimodal recognitiontrajectory clusteringunsupervised learningvisual speech

Autor:innen und Institutionen

  • Faculty of Information Technologies, L.N. Gumilyov Eurasian National University, Astana 010008, Kazakhstan.
  • Department of Computer Science, Lublin University of Technology, 36B Nadbystrzycka Str., 20-618 Lublin, Poland.
  • Institute of Economics, Information Technologies and Professional Education, Zangir Khan West Kazakhstan Agrarion-Technical University, Uralsk 090000, Kazakhstan.

ORCID-Profile: Nurzada Amangeldy, Nazerke Gazizova, Marek Milosz, Bekbolat Kurmetbek, Aizhan Nazyrova, Akmaral Kassymova

Förderung

  • Ministry of Science and Higher Education of the Republic of Kazakhstan
  • Ministry of Science and Higher Education

Zitieren

APA

Amangeldy, N., Gazizova, N., Milosz, M., Kurmetbek, B., Nazyrova, A., & Kassymova, A. (2025). Unsupervised Clustering and Ensemble Learning for Classifying Lip Articulation in Fingerspelling. Sensors. https://doi.org/10.3390/s25123703

Vancouver

Amangeldy N, Gazizova N, Milosz M, Kurmetbek B, Nazyrova A, Kassymova A. Unsupervised Clustering and Ensemble Learning for Classifying Lip Articulation in Fingerspelling. Sensors. 2025. doi:10.3390/s25123703

BibTeX
@article{Amangeldy2025,
  author = {Amangeldy, Nurzada and Gazizova, Nazerke and Milosz, Marek and Kurmetbek, Bekbolat and Nazyrova, Aizhan and Kassymova, Akmaral},
  title = {Unsupervised Clustering and Ensemble Learning for Classifying Lip Articulation in Fingerspelling},
  journal = {Sensors},
  year = {2025},
  doi = {10.3390/s25123703}
}
Kostenlos starten →