LapiDude: Biometric-Authenticated Multilingual Framework for Secure Desktop Automation
INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT · 18.03.2026 · 10 (03) · 1-9
DOI: 10.55041/ijsrem57895 ↗Kurz gefasst
Fachartikel in der Zeitschrift INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, online erschienen am 18.03.2026. Verfasst von PULIPATI SYAMBABU und 5 weiteren Autor:innen.
Abstract (Originalsprache)
Abstract— Over the years, voice-based interaction has become an important interface paradigm in today’s computing systems. Voice interactions has become widespread with mobile devices and structured on smart assistants, desktop environments still depends on manual input via keyboards and pointing devices. Additionally, since most desktop automation tools do not even check whether the user sending commands is who he/she claims to be, there are security implications when performing operations on a system level are executed through automated processes. Also, another gap of current systems which makes them not much efficient is that they do not provide multilingual corpus since a majority of available voice interaction framework are designed to be helpful only for English based users. This work proposes a new biometric-authenticated multilingual framework, LapiDude for secure voice-driven desktop automation. It utilizes speaker verification models on top of multi-lingual command recognition to allow users to control desktop applications with natural spoken phrases, but only allows authorized speakers to issue commands. We use deep speaker embeddings from a pretrained voice representation to perform speaker verification. It uses cosine similarity to match incoming voice samples against stored administrator voiceprints in order to authenticate identity. The spoken command gets transformed to text post successful authentication and subsequently passed through a multilingual keyword-based intent mapping mechanism that can understand a command in English, Hindi and Telugu. The recognized commands are then mapped to the relevant desktop automation functions (e.g., launching applications, controlling processes, window handling). The framework works fully on local hardware, which improves privacy and decreases the response latency. Experimental assessment reveals that we perform secure recognition (average similarity < 0.65) and average command execution latency < 200 ms, the results demonstrate that the proposed framework is an efficient and secure mechanism for enabling multidimensional verbal-based desktop pages. Key Words - Voice Biometrics, Desktop Automation, Multilingual Voice Commands, Human–Computer Interaction, Speaker Authentication, Pattern Recognition
Zitieren
APA
SYAMBABU, P., HIMABINDU, R., BEGUM, S. R. R., TARUNI, S., BHARGAV, V., & PRATAP, P. (2026). LapiDude: Biometric-Authenticated Multilingual Framework for Secure Desktop Automation. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT, 10(03), 1-9. https://doi.org/10.55041/ijsrem57895
Vancouver
SYAMBABU P, HIMABINDU R, BEGUM SRR, TARUNI S, BHARGAV V, PRATAP P. LapiDude: Biometric-Authenticated Multilingual Framework for Secure Desktop Automation. INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT. 2026;10(03):1-9. doi:10.55041/ijsrem57895
BibTeX
@article{SYAMBABU2026,
author = {SYAMBABU, PULIPATI and HIMABINDU, RANGANI and BEGUM, SHAIK ROOHI REHANA and TARUNI, SINGAMSETTY and BHARGAV, VALLA and PRATAP, PONUGUPATI},
title = {LapiDude: Biometric-Authenticated Multilingual Framework for Secure Desktop Automation},
journal = {INTERNATIONAL JOURNAL OF SCIENTIFIC RESEARCH IN ENGINEERING AND MANAGEMENT},
year = {2026},
volume = {10},
number = {03},
pages = {1--9},
doi = {10.55041/ijsrem57895}
}
EUVIMED