EUVIMEDEUVIMED entdecken
VergleichsstudieOpen Access · CC BY-NC 4.0

Is Less Sometimes More? An Experimental Comparison of Four Measures of Perceived Usability

Elisa Gräve iD, Axel Buchner

Human Factors: The Journal of the Human Factors and Ergonomics Society · 2025

DOI: 10.1177/00187208241237862 ↗

Kurz gefasst

Vergleichsstudie in der Zeitschrift Human Factors: The Journal of the Human Factors and Ergonomics Society, 2025. Verfasst von Elisa Gräve und 1 weiteren Autor:innen. Beteiligte Einrichtung: Heinrich Heine University Düsseldorf, Düsseldorf, Germany. Hauptthemen laut MEDLINE: User-Computer Interface. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objective

In usability studies, the subjective component of usability, perceived usability, is often of interest besides the objective usability components, efficiency and effectiveness. Perceived usability is typically investigated using questionnaires. Our goal was to assess experimentally which of four perceived-usability questionnaires differing in length best reflects the difference in perceived usability between systems.

Background

Conventional measurement wisdom strongly favors multi-item questionnaires, as measures based on more items supposedly yield better results. However, this assumption is controversial. Single-item questionnaires also have distinct advantages and it has been shown repeatedly that single-item measures can be viable alternatives to multi-item measures.

Method

N = 1089 (Experiment 1) and N = 1095 (Experiment 2) participants rated the perceived usability of a good or a poor web-based mobile phone contract system using the 35-item ISONORM 9241/10 (Experiment 1 only), the 10-item System Usability Scale (SUS), the 4-item Usability Metric for User Experience (UMUX), and the single-item Adjective Rating Scale.

Results

The Adjective Rating Scale represented the perceived-usability difference between both systems at least as good as, or significantly better than, the multi-item questionnaires (significantly better than the UMUX and the ISONORM 9241/10 in Experiment 1, significantly better than the SUS in Experiment 2).

Conclusion

The single-item Adjective Rating Scale is a viable alternative to multi-item perceived-usability questionnaires. Application Extremely short instruments can be recommended to measure perceived usability, at least for simple user interfaces that can be considered concrete-singular in the sense that raters understand which entity is being rated and what is being rated is reasonably homogenous.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

User-Computer InterfaceHumansAdultSurveys and QuestionnairesMaleFemaleYoung AdultMiddle AgedCell PhoneErgonomics

Stichwörter der Autor:innen

ISONORMadjective rating scalestandardized questionnairessystem usability scaleusability metric for user experience

Autor:innen und Institutionen

  • Heinrich Heine University Düsseldorf, Düsseldorf, Germany.

ORCID-Profile: Elisa Gräve

Zitieren

APA

Gräve, E., & Buchner, A. (2025). Is Less Sometimes More? An Experimental Comparison of Four Measures of Perceived Usability. Human Factors: The Journal of the Human Factors and Ergonomics Society. https://doi.org/10.1177/00187208241237862

Vancouver

Gräve E, Buchner A. Is Less Sometimes More? An Experimental Comparison of Four Measures of Perceived Usability. Human Factors: The Journal of the Human Factors and Ergonomics Society. 2025. doi:10.1177/00187208241237862

BibTeX
@article{Grve2025,
  author = {Gräve, Elisa and Buchner, Axel},
  title = {Is Less Sometimes More? An Experimental Comparison of Four Measures of Perceived Usability},
  journal = {Human Factors: The Journal of the Human Factors and Ergonomics Society},
  year = {2025},
  doi = {10.1177/00187208241237862}
}
Kostenlos starten →