EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Model for Cognitive Personalization of Microtask Design

Dennis Paulino iD, Diogo Guimarães, António Correia iD, José Ribeiro, João Barroso iD, Hugo Paredes iD

Sensors · 2023

DOI: 10.3390/s23073571 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Dennis Paulino und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Science and Technology, University of Trás-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal. Hauptthemen laut MEDLINE: Crowdsourcing. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundação para a Ciência e Tecnologia, FCT—Fundação para a Ciência e a Tecnologia (Portuguese Foundation for Science and Technology), European Social Fund.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The study of data quality in crowdsourcing campaigns is currently a prominent research topic, given the diverse range of participants involved. A potential solution to enhancing data quality processes in crowdsourcing is cognitive personalization, which involves appropriately adapting or assigning tasks based on a crowd worker’s cognitive profile. There are two common methods for assessing a crowd worker’s cognitive profile: administering online cognitive tests, and inferring behavior from task fingerprinting based on user interaction log events. This article presents the findings of a study that investigated the complementarity of both approaches in a microtask scenario, focusing on personalizing task design. The study involved 134 unique crowd workers recruited from a crowdsourcing marketplace. The main objective was to examine how the administration of cognitive ability tests can be used to allocate crowd workers to microtasks with varying levels of difficulty, including the development of a deep learning model. Another goal was to investigate if task fingerprinting can be used to allocate crowd workers to different microtasks in a personalized manner. The results indicated that both objectives were accomplished, validating the usage of cognitive tests and task fingerprinting as effective mechanisms for microtask personalization, including the development of a deep learning model with 95% accuracy in predicting the accuracy of the microtasks. While we achieved an accuracy of 95%, it is important to note that the small dataset size may have limited the model’s performance.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

CrowdsourcingHumansData AccuracyCognition

Stichwörter der Autor:innen

cognitive abilitiescrowdsourcinghuman-computer interactionmicrotask designpersonalizationtask fingerprinting

Autor:innen und Institutionen

  • School of Science and Technology, University of Trás-os-Montes e Alto Douro, 5000-801 Vila Real, Portugal.
  • INESC TEC, 4200-465 Porto, Portugal.

ORCID-Profile: Dennis Paulino, António Correia, João Barroso, Hugo Paredes

Förderung

  • Fundação para a Ciência e Tecnologia
  • FCT—Fundação para a Ciência e a Tecnologia (Portuguese Foundation for Science and Technology)
  • European Social Fund

Zitieren

APA

Paulino, D., Guimarães, D., Correia, A., Ribeiro, J., Barroso, J., & Paredes, H. (2023). A Model for Cognitive Personalization of Microtask Design. Sensors. https://doi.org/10.3390/s23073571

Vancouver

Paulino D, Guimarães D, Correia A, Ribeiro J, Barroso J, Paredes H. A Model for Cognitive Personalization of Microtask Design. Sensors. 2023. doi:10.3390/s23073571

BibTeX
@article{Paulino2023,
  author = {Paulino, Dennis and Guimarães, Diogo and Correia, António and Ribeiro, José and Barroso, João and Paredes, Hugo},
  title = {A Model for Cognitive Personalization of Microtask Design},
  journal = {Sensors},
  year = {2023},
  doi = {10.3390/s23073571}
}
Kostenlos starten →