GestOS: A Real-Time Multimodal Hand Gesture and Voice Based Human Computer Interaction System.
INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · 16.04.2026 · 10 (04) · 1-9
DOI: 10.55041/ijsrem60318 ↗Kurz gefasst
Fachartikel in der Zeitschrift INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, online erschienen am 16.04.2026. Verfasst von Prof. M.S. Bhosale und 4 weiteren Autor:innen.
Abstract (Originalsprache)
- Hand gesture recognition and voice-based interaction are becoming natural alternatives to traditional input devices in human-computer interaction (HCI). However, many existing systems face high latency, limited scalability, or depend on a single interaction method. This paper presents GestOS, a real- time multimodal HCI system that combines hand gesture recognition and voice command processing to control a computer without physical input devices. The system uses MediaPipe for efficient hand landmark detection and applies a rule-based gesture classification method for low-latency performance. At the same time, a grammar- constrained voice recognition module is created using Windows Speech API to ensure high accuracy and few false positives. A multiprocessing structure is used to get past Python’s Global Interpreter Lock (GIL), allowing simultaneous execution of vision, voice, and command- processing modules. Experimental evaluation shows that the system provides real-time responsiveness with low latency and dependable gesture recognition in controlled settings. This approach offers a cost-effective, scalable, and practical solution for next-generation HCI applications, such as accessibility systems, smart environments, and touchless computing interfaces Key Words: Hand Gesture Recognition, Human-Computer Interaction (HCI), MediaPipe, Multimodal Interaction, Voice Recognition, Real-Time Systems, Computer Vision, Gesture- Based Control, Speech Interface, Touchless Interaction, Human-Machine Interface, Assistive Technology, OpenCV, Multiprocessing Architecture, Low-Latency Systems, AI- Based Interaction, Natural User Interfaces (NUI).
Zitieren
APA
Bhosale, P. M., Bande, O., Dhagdi, S., Belka, V., & Bedage, O. (2026). GestOS: A Real-Time Multimodal Hand Gesture and Voice Based Human Computer Interaction System. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, 10(04), 1-9. https://doi.org/10.55041/ijsrem60318
Vancouver
Bhosale PM, Bande O, Dhagdi S, Belka V, Bedage O. GestOS: A Real-Time Multimodal Hand Gesture and Voice Based Human Computer Interaction System. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT. 2026;10(04):1-9. doi:10.55041/ijsrem60318
BibTeX
@article{Bhosale2026,
author = {Bhosale, Prof. M.S. and Bande, Om and Dhagdi, Swapnil and Belka, Vighnesh and Bedage, Omprakash},
title = {GestOS: A Real-Time Multimodal Hand Gesture and Voice Based Human Computer Interaction System},
journal = {INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT},
year = {2026},
volume = {10},
number = {04},
pages = {1--9},
doi = {10.55041/ijsrem60318}
}
EUVIMED