EUVIMEDScopri EUVIMED
Open access · CC BY 4.0

Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic Review

Morten Hertzum

ACM Transactions on Computer-Human Interaction · 2024-06-30 · 31 (3) · 1-29

DOI: 10.1145/3665327 ↗

At a glance

Journal article in ACM Transactions on Computer-Human Interaction, published online on 2024-08-30. Written by Morten Hertzum. Cited 26 times so far (Crossref); 72 references. The full text is freely available (open access, CC BY 4.0).

AbstractDati bibliograficiCiteRelated studies

Abstract (original language)

In usability tests, the users are commonly asked to think aloud to let the evaluator listen in on their thoughts. Two variants of this procedure involve that the users either think aloud while using the tested product (concurrent thinking aloud, CTA) or after using it (retrospective thinking aloud, RTA). This study reviews the studies that compare CTA and RTA to investigate what is gained and lost by using one or the other variant in a usability test. A total of 29 studies, reporting from 42 comparisons of CTA and RTA, matched the inclusion criteria and were included in the meta-analyses. The main differences are that for CTA task time is longer, but total time shorter, whereas for RTA the users verbalize more explanations, problem formulations, and design recommendations. In addition, CTA users probably experience the evaluator’s presence as less disturbing than RTA users do.

Cite

APA

Hertzum, M. (2024). Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic Review. ACM Transactions on Computer-Human Interaction, 31(3), 1-29. https://doi.org/10.1145/3665327

Vancouver

Hertzum M. Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic Review. ACM Transactions on Computer-Human Interaction. 2024;31(3):1-29. doi:10.1145/3665327

BibTeX
@article{Hertzum2024,
  author = {Hertzum, Morten},
  title = {Concurrent or Retrospective Thinking Aloud in Usability Tests: A Meta-Analytic Review},
  journal = {ACM Transactions on Computer-Human Interaction},
  year = {2024},
  volume = {31},
  number = {3},
  pages = {1--29},
  doi = {10.1145/3665327}
}
Start for free →