EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Validation of system usability scale as a usability metric to evaluate voice user interfaces

Akshay Madhav Deshmukh, Ricardo Chalmeta

PeerJ Computer Science · 29.02.2024 · 10 · e1918

DOI: 10.7717/peerj-cs.1918 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 29.02.2024. Verfasst von Akshay Madhav Deshmukh und 1 weiteren Autor:innen. Beteiligte Einrichtung: Systems Integration and Re-Engineering Group (IRIS), Department of Computer Languages and Systems, Universitat Jaume I de Castellón, Castello de la P…. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, user experience (UX) has gained importance in the field of interactive systems. To ensure its success, interactive systems must be evaluated. As most of the standardized evaluation tools are dedicated to graphical user interfaces (GUIs), the evaluation of voice-based interactive systems or voice user interfaces is still in its infancy. With the help of a well-established evaluation scale, the System Usability Scale (SUS), two prominent, widely accepted voice assistants were evaluated. The evaluation, with SUS, was conducted with 16 participants who performed a set of tasks on Amazon Alexa Echo Dot and Google Nest Mini. We compared the SUS score of Amazon Alexa Echo Dot and Google Nest Mini. Furthermore, we derived the confidence interval for both voice assistants. To enhance understanding for usability practitioners, we analyzed the Adjective Rating Score of both interfaces to comprehend the experience of an interface’s usability through words rather than numbers. Additionally, we validated the correlation between the SUS score and the Adjective Rating Score. Finally, a paired sample t-test was conducted to compare the SUS score of Amazon Alexa Echo Dot and Google Nest Mini. This resulted in a huge difference in scores. Hence, in this study, we corroborate the utility of the SUS in voice user interfaces and conclude by encouraging researchers to use SUS as a usability metric to evaluate voice user interfaces.

Schlagwörter

Stichwörter der Autor:innen

Adjective rating scaleSystem usability scaleUsability evaluationVoice assistantsVoice user interface

Autor:innen und Institutionen

  • Systems Integration and Re-Engineering Group (IRIS), Department of Computer Languages and Systems, Universitat Jaume I de Castellón, Castello de la Plana, Castellon, Spain.

Zitieren

APA

Deshmukh, A. M., & Chalmeta, R. (2024). Validation of system usability scale as a usability metric to evaluate voice user interfaces. PeerJ Computer Science, 10, e1918. https://doi.org/10.7717/peerj-cs.1918

Vancouver

Deshmukh AM, Chalmeta R. Validation of system usability scale as a usability metric to evaluate voice user interfaces. PeerJ Computer Science. 2024;10:e1918. doi:10.7717/peerj-cs.1918

BibTeX
@article{Deshmukh2024,
  author = {Deshmukh, Akshay Madhav and Chalmeta, Ricardo},
  title = {Validation of system usability scale as a usability metric to evaluate voice user interfaces},
  journal = {PeerJ Computer Science},
  year = {2024},
  volume = {10},
  pages = {e1918},
  doi = {10.7717/peerj-cs.1918}
}
Kostenlos starten →