Multimodal Command System for HumanComputer Interaction
International Journal of Innovative Science and Research Technology · 07.03.2026 · 2902
DOI: 10.38124/ijisrt/26feb1459 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Innovative Science and Research Technology, online erschienen am 07.03.2026. Verfasst von Harikumar M. und 2 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben.
Abstract (Originalsprache)
Recent advances in computing have increased the demand for interaction paradigms that enable intuitive and efficient communication between users and digital systems. Traditional interfaces such as keyboards and mice often limit accessibility and natural interaction, particularly in complex or hands-free environments. This paper proposes a multimodal human–computer interaction system that integrates hand gesture recognition and voice command processing to enable seamless desktop control and interaction with external applications. The system employs MediaPipe-based hand landmark extraction and speech-to-text processing, coordinated through an AI agent using the Model Context Protocol (MCP) for task orchestration and service integration. Experimental evaluation demonstrates that the proposed framework achieves high recognition accuracy with low latency, supporting real-time interaction across local and cloud-based services. The results indicate that multimodal fusion combined with agent-based automation enhances usability, responsiveness, and accessibility, positioning the system as a scalable solution for next-generation human–computer interaction.
Zitieren
APA
M., H., D., P., & George, R. A. (2026). Multimodal Command System for HumanComputer Interaction. International Journal of Innovative Science and Research Technology, 2902. https://doi.org/10.38124/ijisrt/26feb1459
Vancouver
M. H, D. P, George RA. Multimodal Command System for HumanComputer Interaction. International Journal of Innovative Science and Research Technology. 2026:2902. doi:10.38124/ijisrt/26feb1459
BibTeX
@article{M2026,
author = {M., Harikumar and D., Prasanth and George, Reuben Abraham},
title = {Multimodal Command System for HumanComputer Interaction},
journal = {International Journal of Innovative Science and Research Technology},
year = {2026},
pages = {2902},
doi = {10.38124/ijisrt/26feb1459}
}
EUVIMED