Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic Review
ACM Transactions on Computer-Human Interaction · 2024-06-30 · 31 (3) · 1-29
DOI: 10.1145/3665327 ↗At a glance
Journal article in ACM Transactions on Computer-Human Interaction, published online on 2024-08-30. Written by Morten Hertzum. Cited 26 times so far (Crossref); 72 references. The full text is freely available (open access, CC BY 4.0).
Abstract (original language)
In usability tests, the users are commonly asked to think aloud to let the evaluator listen in on their thoughts. Two variants of this procedure involve that the users either think aloud while using the tested product (concurrent thinking aloud, CTA) or after using it (retrospective thinking aloud, RTA). This study reviews the studies that compare CTA and RTA to investigate what is gained and lost by using one or the other variant in a usability test. A total of 29 studies, reporting from 42 comparisons of CTA and RTA, matched the inclusion criteria and were included in the meta-analyses. The main differences are that for CTA task time is longer, but total time shorter, whereas for RTA the users verbalize more explanations, problem formulations, and design recommendations. In addition, CTA users probably experience the evaluator’s presence as less disturbing than RTA users do.
Cite
APA
Hertzum, M. (2024). Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic Review. ACM Transactions on Computer-Human Interaction, 31(3), 1-29. https://doi.org/10.1145/3665327
Vancouver
Hertzum M. Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic Review. ACM Transactions on Computer-Human Interaction. 2024;31(3):1-29. doi:10.1145/3665327
BibTeX
@article{Hertzum2024,
author = {Hertzum, Morten},
title = {Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic Review},
journal = {ACM Transactions on Computer-Human Interaction},
year = {2024},
volume = {31},
number = {3},
pages = {1--29},
doi = {10.1145/3665327}
}
EUVIMED