EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

AI-Powered Automation Companion: A Semantic-Aware On-Device Mobile Automation Framework

D Anusha, B Guru Preetam, K Bhavya Sri, M Sriman Narayana, D Manoj Reddy

International Research Journal on Advanced Engineering and Management (IRJAEM) · 02.04.2026 · 4 (03) · 598-603

DOI: 10.47392/irjaem.2026.0093 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Research Journal on Advanced Engineering and Management (IRJAEM), online erschienen am 02.04.2026. Verfasst von D Anusha und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Manual execution of repetitive mobile tasks is inefficient, and existing automation tools rely on brittle coordinate-based mechanisms or privacy-invasive cloud processing. This paper presents the AI-Powered Automation Companion, a comprehensive, offline-first Android framework designed for adaptive, privacy-preserving task automation. The system replaces rigid coordinates with semantic screen understanding by deploying a quantized YOLOv11s (INT8) model directly on-device. To manage complex logic, this vision engine is integrated with a visual node-based Flow Builder and cross-device LAN synchronization. The framework also supports context modules—including location, battery, and app-specific triggers—to enable intelligent, multi-app routines. Experimental evaluation demonstrates that the proposed semantic pipeline achieves a mean Average Precision (mAP@0.5) of 0.846 while maintaining an effective inference latency of ~230 ms. Furthermore, robustness testing shows the system maintains a 95% workflow success rate under dynamic UI layout changes. By combining local AI, a visual workflow editor, and cross-device execution, the framework delivers a robust, explainable, and fully private automation ecosystem at the edge.

Zitieren

APA

Anusha, D., Preetam, B. G., Sri, K. B., Narayana, M. S., & Reddy, D. M. (2026). AI-Powered Automation Companion: A Semantic-Aware On-Device Mobile Automation Framework. International Research Journal on Advanced Engineering and Management (IRJAEM), 4(03), 598-603. https://doi.org/10.47392/irjaem.2026.0093

Vancouver

Anusha D, Preetam BG, Sri KB, Narayana MS, Reddy DM. AI-Powered Automation Companion: A Semantic-Aware On-Device Mobile Automation Framework. International Research Journal on Advanced Engineering and Management (IRJAEM). 2026;4(03):598-603. doi:10.47392/irjaem.2026.0093

BibTeX
@article{Anusha2026,
  author = {Anusha, D and Preetam, B Guru and Sri, K Bhavya and Narayana, M Sriman and Reddy, D Manoj},
  title = {AI-Powered Automation Companion: A Semantic-Aware On-Device Mobile Automation Framework},
  journal = {International Research Journal on Advanced Engineering and Management (IRJAEM)},
  year = {2026},
  volume = {4},
  number = {03},
  pages = {598--603},
  doi = {10.47392/irjaem.2026.0093}
}
Kostenlos starten →