EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Enhancing smart home interaction through multimodal command disambiguation

Tommaso Calò, Luigi De Russis

Personal and Ubiquitous Computing · 2024-12 · 28 (6) · 985-1000

DOI: 10.1007/s00779-024-01827-3 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Personal and Ubiquitous Computing, online erschienen am 22.07.2024. Verfasst von Tommaso Calò und 1 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Politecnico di Torino.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Smart speakers are entering our homes and enriching the connected ecosystem already present in them. Home inhabitants can use those to execute relatively simple commands, e.g., turning a lamp on. Their capabilities to interpret more complex and ambiguous commands (e.g., make this room warmer) are limited, if not absent. Large language models (LLMs) can offer creative and viable solutions to enable a practical and user-acceptable interpretation of such ambiguous commands. This paper introduces an interactive disambiguation approach that integrates visual and textual cues with natural language commands. After contextualizing the approach with a use case, we test it in an experiment where users are prompted to select the appropriate cue (an image or a textual description) to clarify ambiguous commands, thereby refining the accuracy of the system’s interpretations. Outcomes from the study indicate that the disambiguation system produces responses well-aligned with user intentions, and that participants found the textual descriptions slightly more effective. Finally, interviews reveal heightened satisfaction with the smart-home system when engaging with the proposed disambiguation approach.

Förderung

  • Politecnico di Torino

Zitieren

APA

Calò, T., & Russis, L. D. (2024). Enhancing smart home interaction through multimodal command disambiguation. Personal and Ubiquitous Computing, 28(6), 985-1000. https://doi.org/10.1007/s00779-024-01827-3

Vancouver

Calò T, Russis LD. Enhancing smart home interaction through multimodal command disambiguation. Personal and Ubiquitous Computing. 2024;28(6):985-1000. doi:10.1007/s00779-024-01827-3

BibTeX
@article{Cal2024,
  author = {Calò, Tommaso and Russis, Luigi De},
  title = {Enhancing smart home interaction through multimodal command disambiguation},
  journal = {Personal and Ubiquitous Computing},
  year = {2024},
  volume = {28},
  number = {6},
  pages = {985--1000},
  doi = {10.1007/s00779-024-01827-3}
}
Kostenlos starten →