Validation of system usability scale as a usability metric to evaluate voice user interfaces
PeerJ Computer Science · 29.02.2024 · 10 · e1918
DOI: 10.7717/peerj-cs.1918 ↗Kurz gefasst
Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 29.02.2024. Verfasst von Akshay Madhav Deshmukh und 1 weiteren Autor:innen. Beteiligte Einrichtung: Systems Integration and Re-Engineering Group (IRIS), Department of Computer Languages and Systems, Universitat Jaume I de Castellón, Castello de la P…. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In recent years, user experience (UX) has gained importance in the field of interactive systems. To ensure its success, interactive systems must be evaluated. As most of the standardized evaluation tools are dedicated to graphical user interfaces (GUIs), the evaluation of voice-based interactive systems or voice user interfaces is still in its infancy. With the help of a well-established evaluation scale, the System Usability Scale (SUS), two prominent, widely accepted voice assistants were evaluated. The evaluation, with SUS, was conducted with 16 participants who performed a set of tasks on Amazon Alexa Echo Dot and Google Nest Mini. We compared the SUS score of Amazon Alexa Echo Dot and Google Nest Mini. Furthermore, we derived the confidence interval for both voice assistants. To enhance understanding for usability practitioners, we analyzed the Adjective Rating Score of both interfaces to comprehend the experience of an interface’s usability through words rather than numbers. Additionally, we validated the correlation between the SUS score and the Adjective Rating Score. Finally, a paired sample t-test was conducted to compare the SUS score of Amazon Alexa Echo Dot and Google Nest Mini. This resulted in a huge difference in scores. Hence, in this study, we corroborate the utility of the SUS in voice user interfaces and conclude by encouraging researchers to use SUS as a usability metric to evaluate voice user interfaces.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Systems Integration and Re-Engineering Group (IRIS), Department of Computer Languages and Systems, Universitat Jaume I de Castellón, Castello de la Plana, Castellon, Spain.
Zitieren
APA
Deshmukh, A. M., & Chalmeta, R. (2024). Validation of system usability scale as a usability metric to evaluate voice user interfaces. PeerJ Computer Science, 10, e1918. https://doi.org/10.7717/peerj-cs.1918
Vancouver
Deshmukh AM, Chalmeta R. Validation of system usability scale as a usability metric to evaluate voice user interfaces. PeerJ Computer Science. 2024;10:e1918. doi:10.7717/peerj-cs.1918
BibTeX
@article{Deshmukh2024,
author = {Deshmukh, Akshay Madhav and Chalmeta, Ricardo},
title = {Validation of system usability scale as a usability metric to evaluate voice user interfaces},
journal = {PeerJ Computer Science},
year = {2024},
volume = {10},
pages = {e1918},
doi = {10.7717/peerj-cs.1918}
}
EUVIMED