You have interrupted me again!: making voice assistants more dementia-friendly with incremental clarification
Frontiers in Dementia · 12.03.2024 · 3
DOI: 10.3389/frdem.2024.1343052 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Dementia, online erschienen am 12.03.2024. Verfasst von Angus Addlesee und 1 weiteren Autor:innen. Beteiligte Einrichtung: Interaction Lab, Heriot-Watt University, Edinburgh, United Kingdom. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 186 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Horizon 2020.
Themen: Demenz
Abstract (Originalsprache)
In spontaneous conversation, speakers seldom have a full plan of what they are going to say in advance: they need to conceptualise and plan incrementally as they articulate each word in turn. This often leads to long pauses mid-utterance. Listeners either wait out the pause, offer a possible completion, or respond with an incremental clarification request (iCR), intended to recover the rest of the truncated turn. The ability to generate iCRs in response to pauses is therefore important in building natural and robust everyday voice assistants (EVA) such as Amazon Alexa. This becomes crucial with people with dementia (PwDs) as a target user group since they are known to pause longer and more frequently, with current state-of-the-art EVAs interrupting them prematurely, leading to frustration and breakdown of the interaction. In this article, we first use two existing corpora of truncated utterances to establish the generation of clarification requests as an effective strategy for recovering from interruptions. We then proceed to report on, analyse, and release SLUICE-CR: a new corpus of 3,000 crowdsourced, human-produced iCRs, the first of its kind. We use this corpus to probe the incremental processing capability of a number of state-of-the-art large language models (LLMs) by evaluating (1) the quality of the model's generated iCRs in response to incomplete questions and (2) the ability of the said LLMs to respond correctly after the users response to the generated iCR. For (1), our experiments show that the ability to generate contextually appropriate iCRs only emerges at larger LLM sizes and only when prompted with example iCRs from our corpus. For (2), our results are in line with (1), that is, that larger LLMs interpret incremental clarificational exchanges more effectively. Overall, our results indicate that autoregressive language models (LMs) are, in principle, able to both understand and generate language incrementally and that LLMs can be configured to handle speech phenomena more commonly produced by PwDs, mitigating frustration with today's EVAs by improving their accessibility.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Interaction Lab, Heriot-Watt University, Edinburgh, United Kingdom.
- Alana AI, Edinburgh, United Kingdom.
Förderung
- Horizon 2020
Zitieren
APA
Addlesee, A., & Eshghi, A. (2024). You have interrupted me again!: making voice assistants more dementia-friendly with incremental clarification. Frontiers in Dementia, 3. https://doi.org/10.3389/frdem.2024.1343052
Vancouver
Addlesee A, Eshghi A. You have interrupted me again!: making voice assistants more dementia-friendly with incremental clarification. Frontiers in Dementia. 2024;3. doi:10.3389/frdem.2024.1343052
BibTeX
@article{Addlesee2024,
author = {Addlesee, Angus and Eshghi, Arash},
title = {You have interrupted me again!: making voice assistants more dementia-friendly with incremental clarification},
journal = {Frontiers in Dementia},
year = {2024},
volume = {3},
doi = {10.3389/frdem.2024.1343052}
}
EUVIMED