EUVIMEDEUVIMED entdecken
Crossref

GestOS: A Real-Time Multimodal Hand Gesture and Voice Based Human Computer Interaction System.

Prof. M.S. Bhosale, Om Bande, Swapnil Dhagdi, Vighnesh Belka, Omprakash Bedage

INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · 16.04.2026 · 10 (04) · 1-9

DOI: 10.55041/ijsrem60318 ↗

Kurz gefasst

Fachartikel in der Zeitschrift INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, online erschienen am 16.04.2026. Verfasst von Prof. M.S. Bhosale und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

- Hand gesture recognition and voice-based interaction are becoming natural alternatives to traditional input devices in human-computer interaction (HCI). However, many existing systems face high latency, limited scalability, or depend on a single interaction method. This paper presents GestOS, a real- time multimodal HCI system that combines hand gesture recognition and voice command processing to control a computer without physical input devices. The system uses MediaPipe for efficient hand landmark detection and applies a rule-based gesture classification method for low-latency performance. At the same time, a grammar- constrained voice recognition module is created using Windows Speech API to ensure high accuracy and few false positives. A multiprocessing structure is used to get past Python’s Global Interpreter Lock (GIL), allowing simultaneous execution of vision, voice, and command- processing modules. Experimental evaluation shows that the system provides real-time responsiveness with low latency and dependable gesture recognition in controlled settings. This approach offers a cost-effective, scalable, and practical solution for next-generation HCI applications, such as accessibility systems, smart environments, and touchless computing interfaces Key Words: Hand Gesture Recognition, Human-Computer Interaction (HCI), MediaPipe, Multimodal Interaction, Voice Recognition, Real-Time Systems, Computer Vision, Gesture- Based Control, Speech Interface, Touchless Interaction, Human-Machine Interface, Assistive Technology, OpenCV, Multiprocessing Architecture, Low-Latency Systems, AI- Based Interaction, Natural User Interfaces (NUI).

Zitieren

APA

Bhosale, P. M., Bande, O., Dhagdi, S., Belka, V., & Bedage, O. (2026). GestOS: A Real-Time Multimodal Hand Gesture and Voice Based Human Computer Interaction System. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, 10(04), 1-9. https://doi.org/10.55041/ijsrem60318

Vancouver

Bhosale PM, Bande O, Dhagdi S, Belka V, Bedage O. GestOS: A Real-Time Multimodal Hand Gesture and Voice Based Human Computer Interaction System. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT. 2026;10(04):1-9. doi:10.55041/ijsrem60318

BibTeX
@article{Bhosale2026,
  author = {Bhosale, Prof. M.S. and Bande, Om and Dhagdi, Swapnil and Belka, Vighnesh and Bedage, Omprakash},
  title = {GestOS: A Real-Time Multimodal Hand Gesture and Voice Based Human Computer Interaction System},
  journal = {INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT},
  year = {2026},
  volume = {10},
  number = {04},
  pages = {1--9},
  doi = {10.55041/ijsrem60318}
}
Kostenlos starten →