EUVIMEDEUVIMED entdecken
Crossref

Edge AI-Based Object Detection via Voice Recognition with an LLM-Based Emotional Assistant for Elderly Care Robots

Sarra Ben Halima, Faten Ben Abdallah, Joseph Haggege

International Journal of Information Technology and Computer Science · 08.08.2026 · 18 (4) · 50-67

DOI: 10.5815/ijitcs.2026.04.04 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Information Technology and Computer Science, erschienen am 08.08.2026. Verfasst von Sarra Ben Halima und 2 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a fully integrated, real-time assistive system that combines voice-based object recognition with a generative conversational interface, specifically designed to enhance elderly care through edge AI deployment. The proposed framework enables intuitive human–robot interaction in domestic environments by fusing natural language understanding, optimized visual detection, and local generative response. Voice commands are processed through a speech-to-text pipeline using the Google Web Speech API, with keyword extraction triggering object detection via a quantized YOLOv8n model accelerated through TensorRT with FP16 inference on an NVIDIA Jetson Nano. In parallel, a locally deployed generative AI assistant, executed entirely on-device, provides empathetic dialogue to support social engagement and emotional well-being. The proposed system adopts a hybrid edge architecture in which object detection, robot control, and LLM-based dialogue generation are executed on-device, while speech-to-text transcription relies on a cloud-based service. This generative interface is implemented as an LLM-based Emotional Assistant. The system achieves 13 FPS with an inference latency of 70 ms for object detection, 94.3% speech recognition accuracy, and an F1-score of 0.69 at a 0.5 confidence threshold. All AI components are executed on-board, preserving privacy for on- device processing while maintaining real-time responsiveness. Experimental validation confirms the effectiveness of deploying multimodal AI, including generative models, on resource-constrained hardware. This work lays the foundation for autonomous, voice-guided care robots that not only assist in locating objects but also engage users socially, promoting greater autonomy and quality of life for older adults.

Zitieren

APA

Halima, S. B., Abdallah, F. B., & Haggege, J. (2026). Edge AI-Based Object Detection via Voice Recognition with an LLM-Based Emotional Assistant for Elderly Care Robots. International Journal of Information Technology and Computer Science, 18(4), 50-67. https://doi.org/10.5815/ijitcs.2026.04.04

Vancouver

Halima SB, Abdallah FB, Haggege J. Edge AI-Based Object Detection via Voice Recognition with an LLM-Based Emotional Assistant for Elderly Care Robots. International Journal of Information Technology and Computer Science. 2026;18(4):50-67. doi:10.5815/ijitcs.2026.04.04

BibTeX
@article{Halima2026,
  author = {Halima, Sarra Ben and Abdallah, Faten Ben and Haggege, Joseph},
  title = {Edge AI-Based Object Detection via Voice Recognition with an LLM-Based Emotional Assistant for Elderly Care Robots},
  journal = {International Journal of Information Technology and Computer Science},
  year = {2026},
  volume = {18},
  number = {4},
  pages = {50--67},
  doi = {10.5815/ijitcs.2026.04.04}
}
Kostenlos starten →