A Model for Cognitive Personalization of Microtask Design
Sensors · 2023
DOI: 10.3390/s23073571 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Dennis Paulino und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Science and Technology, University of Trás-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal. Hauptthemen laut MEDLINE: Crowdsourcing. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundação para a Ciência e Tecnologia, FCT—Fundação para a Ciência e a Tecnologia (Portuguese Foundation for Science and Technology), European Social Fund.
Abstract (Originalsprache)
The study of data quality in crowdsourcing campaigns is currently a prominent research topic, given the diverse range of participants involved. A potential solution to enhancing data quality processes in crowdsourcing is cognitive personalization, which involves appropriately adapting or assigning tasks based on a crowd worker’s cognitive profile. There are two common methods for assessing a crowd worker’s cognitive profile: administering online cognitive tests, and inferring behavior from task fingerprinting based on user interaction log events. This article presents the findings of a study that investigated the complementarity of both approaches in a microtask scenario, focusing on personalizing task design. The study involved 134 unique crowd workers recruited from a crowdsourcing marketplace. The main objective was to examine how the administration of cognitive ability tests can be used to allocate crowd workers to microtasks with varying levels of difficulty, including the development of a deep learning model. Another goal was to investigate if task fingerprinting can be used to allocate crowd workers to different microtasks in a personalized manner. The results indicated that both objectives were accomplished, validating the usage of cognitive tests and task fingerprinting as effective mechanisms for microtask personalization, including the development of a deep learning model with 95% accuracy in predicting the accuracy of the microtasks. While we achieved an accuracy of 95%, it is important to note that the small dataset size may have limited the model’s performance.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Science and Technology, University of Trás-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal.
- INESC TEC, 4200-465 Porto, Portugal.
ORCID-Profile: Dennis Paulino, António Correia, João Barroso, Hugo Paredes
Förderung
- Fundação para a Ciência e Tecnologia
- FCT—Fundação para a Ciência e a Tecnologia (Portuguese Foundation for Science and Technology)
- European Social Fund
Zitieren
APA
Paulino, D., Guimarães, D., Correia, A., Ribeiro, J., Barroso, J., & Paredes, H. (2023). A Model for Cognitive Personalization of Microtask Design. Sensors. https://doi.org/10.3390/s23073571
Vancouver
Paulino D, Guimarães D, Correia A, Ribeiro J, Barroso J, Paredes H. A Model for Cognitive Personalization of Microtask Design. Sensors. 2023. doi:10.3390/s23073571
BibTeX
@article{Paulino2023,
author = {Paulino, Dennis and Guimarães, Diogo and Correia, António and Ribeiro, José and Barroso, João and Paredes, Hugo},
title = {A Model for Cognitive Personalization of Microtask Design},
journal = {Sensors},
year = {2023},
doi = {10.3390/s23073571}
}
EUVIMED