Enhancing smart home interaction through multimodal command disambiguation
Personal and Ubiquitous Computing · 2024-12 · 28 (6) · 985-1000
DOI: 10.1007/s00779-024-01827-3 ↗Kurz gefasst
Fachartikel in der Zeitschrift Personal and Ubiquitous Computing, online erschienen am 22.07.2024. Verfasst von Tommaso Calò und 1 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Politecnico di Torino.
Abstract (Originalsprache)
Smart speakers are entering our homes and enriching the connected ecosystem already present in them. Home inhabitants can use those to execute relatively simple commands, e.g., turning a lamp on. Their capabilities to interpret more complex and ambiguous commands (e.g., make this room warmer) are limited, if not absent. Large language models (LLMs) can offer creative and viable solutions to enable a practical and user-acceptable interpretation of such ambiguous commands. This paper introduces an interactive disambiguation approach that integrates visual and textual cues with natural language commands. After contextualizing the approach with a use case, we test it in an experiment where users are prompted to select the appropriate cue (an image or a textual description) to clarify ambiguous commands, thereby refining the accuracy of the system’s interpretations. Outcomes from the study indicate that the disambiguation system produces responses well-aligned with user intentions, and that participants found the textual descriptions slightly more effective. Finally, interviews reveal heightened satisfaction with the smart-home system when engaging with the proposed disambiguation approach.
Förderung
- Politecnico di Torino
Zitieren
APA
Calò, T., & Russis, L. D. (2024). Enhancing smart home interaction through multimodal command disambiguation. Personal and Ubiquitous Computing, 28(6), 985-1000. https://doi.org/10.1007/s00779-024-01827-3
Vancouver
Calò T, Russis LD. Enhancing smart home interaction through multimodal command disambiguation. Personal and Ubiquitous Computing. 2024;28(6):985-1000. doi:10.1007/s00779-024-01827-3
BibTeX
@article{Cal2024,
author = {Calò, Tommaso and Russis, Luigi De},
title = {Enhancing smart home interaction through multimodal command disambiguation},
journal = {Personal and Ubiquitous Computing},
year = {2024},
volume = {28},
number = {6},
pages = {985--1000},
doi = {10.1007/s00779-024-01827-3}
}
EUVIMED