AI-Powered Automation Companion: A Semantic-Aware On-Device Mobile Automation Framework
International Research Journal on Advanced Engineering and Management (IRJAEM) · 02.04.2026 · 4 (03) · 598-603
DOI: 10.47392/irjaem.2026.0093 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Research Journal on Advanced Engineering and Management (IRJAEM), online erschienen am 02.04.2026. Verfasst von D Anusha und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Manual execution of repetitive mobile tasks is inefficient, and existing automation tools rely on brittle coordinate-based mechanisms or privacy-invasive cloud processing. This paper presents the AI-Powered Automation Companion, a comprehensive, offline-first Android framework designed for adaptive, privacy-preserving task automation. The system replaces rigid coordinates with semantic screen understanding by deploying a quantized YOLOv11s (INT8) model directly on-device. To manage complex logic, this vision engine is integrated with a visual node-based Flow Builder and cross-device LAN synchronization. The framework also supports context modules—including location, battery, and app-specific triggers—to enable intelligent, multi-app routines. Experimental evaluation demonstrates that the proposed semantic pipeline achieves a mean Average Precision (mAP@0.5) of 0.846 while maintaining an effective inference latency of ~230 ms. Furthermore, robustness testing shows the system maintains a 95% workflow success rate under dynamic UI layout changes. By combining local AI, a visual workflow editor, and cross-device execution, the framework delivers a robust, explainable, and fully private automation ecosystem at the edge.
Zitieren
APA
Anusha, D., Preetam, B. G., Sri, K. B., Narayana, M. S., & Reddy, D. M. (2026). AI-Powered Automation Companion: A Semantic-Aware On-Device Mobile Automation Framework. International Research Journal on Advanced Engineering and Management (IRJAEM), 4(03), 598-603. https://doi.org/10.47392/irjaem.2026.0093
Vancouver
Anusha D, Preetam BG, Sri KB, Narayana MS, Reddy DM. AI-Powered Automation Companion: A Semantic-Aware On-Device Mobile Automation Framework. International Research Journal on Advanced Engineering and Management (IRJAEM). 2026;4(03):598-603. doi:10.47392/irjaem.2026.0093
BibTeX
@article{Anusha2026,
author = {Anusha, D and Preetam, B Guru and Sri, K Bhavya and Narayana, M Sriman and Reddy, D Manoj},
title = {AI-Powered Automation Companion: A Semantic-Aware On-Device Mobile Automation Framework},
journal = {International Research Journal on Advanced Engineering and Management (IRJAEM)},
year = {2026},
volume = {4},
number = {03},
pages = {598--603},
doi = {10.47392/irjaem.2026.0093}
}
EUVIMED