Unraveling the impact of Prolific: Exploring the presence of bias when studying psychological constructs related to the use of technology
RICERCHE DI PSICOLOGIA · 2026-10 · (4) · 55-70
DOI: 10.3280/rip2025oa22334 ↗Kurz gefasst
Fachartikel in der Zeitschrift RICERCHE DI PSICOLOGIA, 2026-10. Verfasst von Margherita Lanz und 9 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 26 Literaturangaben.
Abstract (Originalsprache)
This study investigates potential biases in data collected through online paid platforms, specifically Prolific, compared to traditional snowball convenience sampling, when studying psychological constructs related to technology. The researchers analyzed data from a separate study examining ChatGPT adoption among Italian university students, using both Prolific and snowball sampling methods. Three technology-related constructs were examined: technology self-efficacy (SE), technology anxiety (AX), and social norms related to technology use (SN). Analysis of covariance revealed a significant difference between groups in technology self-efficacy (SE), with Prolific participants exhibiting higher scores. No significant differences were found in AX and SN. The findings highlight potential selection bias, suggesting Prolific may attract participants with higher technological confidence. It is important to stress that this difference may also reflect a combination of self-selection into the platform, the presence of financial compensation, and the inherent biases of convenience snowball samples. The study underscores the importance of considering such recruitment-related biases when generalizing research findings, particularly in technology-related studies, and emphasizes the need for transparency in reporting sampling methods.
Zitieren
APA
Lanz, M., Caliciuri, R., Spina, A., Ongaro, A., Sanctis, G. V. D., Vaughn, G. A., Mastroni, M., Barbieri, M., Milani, M., & Sorgente, A. (2026). Unraveling the impact of Prolific: Exploring the presence of bias when studying psychological constructs related to the use of technology. RICERCHE DI PSICOLOGIA, 55-70. https://doi.org/10.3280/rip2025oa22334
Vancouver
Lanz M, Caliciuri R, Spina A, Ongaro A, Sanctis GVD, Vaughn GA, et al. Unraveling the impact of Prolific: Exploring the presence of bias when studying psychological constructs related to the use of technology. RICERCHE DI PSICOLOGIA. 2026:55-70. doi:10.3280/rip2025oa22334
BibTeX
@article{Lanz2026,
author = {Lanz, Margherita and Caliciuri, Rossella and Spina, Alessia and Ongaro, Anna and Sanctis, Gaia Virginia De and Vaughn, Gabriella Anna and Mastroni, Marta and Barbieri, Martina and Milani, Martina and Sorgente, Angela},
title = {Unraveling the impact of Prolific: Exploring the presence of bias when studying psychological constructs related to the use of technology},
journal = {RICERCHE DI PSICOLOGIA},
year = {2026},
number = {4},
pages = {55--70},
doi = {10.3280/rip2025oa22334}
}
EUVIMED