EUVIMEDObjevte EUVIMED
Open access · CC BY 4.0

Real-effort survey designs: Open-ended questions to overcome the challenge of measuring behavior in surveys

Caroline Fischer

Journal of Trial and Error · 2021-09-10 · 2 (1) · 44-53

DOI: 10.36850/e5 ↗

At a glance

Journal article in Journal of Trial and Error, published online on 2021-09-10. Written by Caroline Fischer. Cited 6 times so far (Crossref); 26 references. The full text is freely available (open access, CC BY 4.0).

AbstraktBibliografické údajeCiteRelated studies

Abstract (original language)

Based on data triangulation, open-ended questions can be used to overcome a typical problem with data collection using surveys: Human behavior can only be captured as stated or intended, but not as real behavior. In this study on knowledge sharing in the workplace, a quantitative measure of behavioral intention was accompanied by such a qualitative, open-ended measure of behavior. The latter was used as a proxy for real instead of stated behavior. This item was coded according to the effort a participant made in answering. It is assumed that the greater the effort put into answering the open-ended question, the more likely it is that the described behavior will be performed in reality. A factorial experimental design was used to analyze the effect of rewards on employees’ knowledge-sharing behavior. As a within-subject design was used, participants had to answer three open-ended questions referring to different vignettes. A strong order effect appeared, leading to longer answers on average for the first vignette (baseline) compared to subsequent vignettes, independent of treatment. Therefore, this approach to operationalizing behavior in surveys might not be useful in within-subject designs. However, it can be used in between-subject comparisons when participants are asked to answer to a single vignette.

Cite

APA

Fischer, C. (2021). Real-effort survey designs: Open-ended questions to overcome the challenge of measuring behavior in surveys. Journal of Trial and Error, 2(1), 44-53. https://doi.org/10.36850/e5

Vancouver

Fischer C. Real-effort survey designs: Open-ended questions to overcome the challenge of measuring behavior in surveys. Journal of Trial and Error. 2021;2(1):44-53. doi:10.36850/e5

BibTeX
@article{Fischer2021,
  author = {Fischer, Caroline},
  title = {Real-effort survey designs: Open-ended questions to overcome the challenge of measuring behavior in surveys},
  journal = {Journal of Trial and Error},
  year = {2021},
  volume = {2},
  number = {1},
  pages = {44--53},
  doi = {10.36850/e5}
}
Start for free →