EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Inclusive Offline Learning Platform Integrating Gesture Recognition and Local AI Models

Marius-Valentin Drăgoi iD, Ionuț Nisipeanu iD, Roxana-Adriana Puiu, Florentina-Geanina Tache iD, Teodora-Mihaela Spiridon-Mocioacă, Alexandru Hank, Cozmin Cristoiu iD

Biomimetics · 14.10.2025 · 10 (10) · 693

DOI: 10.3390/biomimetics10100693 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Biomimetics, online erschienen am 14.10.2025. Verfasst von Marius-Valentin Drăgoi und 6 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Industrial Engineering and Robotics, National University of Science and Technology POLITEHNICA Bucharest, 060042 Bucharest, Romania. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper introduces a gesture-controlled conversational interface driven by a local AI model, aimed at improving accessibility and facilitating hands-free interaction within digital environments. The technology utilizes real-time hand gesture recognition via a typical laptop camera and connects with a local AI engine to produce customized learning materials. Users can peruse educational documents, obtain topic summaries, and generate automated quizzes with intuitive gestures, including lateral finger movements, a two-finger gesture, or an open palm, without the need for conventional input devices. Upon selection of a file, the AI model analyzes its whole content, producing a structured summary and a multiple-choice assessment, both of which are immediately saved for subsequent inspection. A unified set of gestures facilitates seamless navigating within the user interface and the opened documents. The system underwent testing with university students and faculty (n = 31), utilizing assessment measures such as gesture detection accuracy, command-response latency, and user satisfaction. The findings demonstrate that the system offers a seamless, hands-free user experience with significant potential for usage in accessibility, human–computer interaction, and intelligent interface design. This work advances the creation of multimodal AI-driven educational aids, providing a pragmatic framework for gesture-based document navigation and intelligent content enhancement.

Schlagwörter

Stichwörter der Autor:innen

accessible user interfacesgesture-based human–computer interactionhands-free interactionhuman factors in computinghuman-centered AI

Autor:innen und Institutionen

  • Faculty of Industrial Engineering and Robotics, National University of Science and Technology POLITEHNICA Bucharest, 060042 Bucharest, Romania.
  • Faculty of Engineering in Foreign Languages, National University of Science and Technology POLITEHNICA Bucharest, 060042 Bucharest, Romania.
  • National Research and Development Institute for Gas Turbines COMOTI, 061126 Bucharest, Romania.

ORCID-Profile: Marius-Valentin Drăgoi, Ionuț Nisipeanu, Florentina-Geanina Tache, Cozmin Cristoiu

Zitieren

APA

Drăgoi, M. V., Nisipeanu, I., Puiu, R. A., Tache, F. G., Spiridon-Mocioacă, T. M., Hank, A., & Cristoiu, C. (2025). An Inclusive Offline Learning Platform Integrating Gesture Recognition and Local AI Models. Biomimetics, 10(10), 693. https://doi.org/10.3390/biomimetics10100693

Vancouver

Drăgoi MV, Nisipeanu I, Puiu RA, Tache FG, Spiridon-Mocioacă TM, Hank A, et al. An Inclusive Offline Learning Platform Integrating Gesture Recognition and Local AI Models. Biomimetics. 2025;10(10):693. doi:10.3390/biomimetics10100693

BibTeX
@article{Drgoi2025,
  author = {Drăgoi, Marius-Valentin and Nisipeanu, Ionuț and Puiu, Roxana-Adriana and Tache, Florentina-Geanina and Spiridon-Mocioacă, Teodora-Mihaela and Hank, Alexandru and Cristoiu, Cozmin},
  title = {An Inclusive Offline Learning Platform Integrating Gesture Recognition and Local AI Models},
  journal = {Biomimetics},
  year = {2025},
  volume = {10},
  number = {10},
  pages = {693},
  doi = {10.3390/biomimetics10100693}
}
Kostenlos starten →