Efficient Task Assignment for Multi-Workerset Crowdsourcing with Time and Expense Considerations
The VLDB Journal · 2026-04 · 35 (3)
DOI: 10.1007/s00778-026-00969-5 ↗Kurz gefasst
Fachartikel in der Zeitschrift The VLDB Journal, online erschienen am 25.04.2026. Verfasst von Yunyi Xiao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 79 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: JSPS KAKENHI, CREST.
Abstract (Originalsprache)
Large-scale crowdsourcing with high-quality results, such as online surveys and data labeling tasks, is in wide demand. Existing techniques on task assignment result quality optimization, however, have addressed only a part of optimization space that does not necessarily reflect the real-world problem. For example, in reality, the proper worker set for task assignment and the workers’ submissions to the task are non-obvious in advance, which is not considered by existing techniques. Hence, this paper discusses a task assignment algorithm that dynamically probes the proper worker set(s) and worker submission models for the task to optimize task assignments in terms of quality, time, and expense. Specifically, we introduce CrowdBwO (Crowd Bandit with Optimization), a novel multi-armed bandit algorithm that is based on batched bandits and bandits with Knapsack and incorporates worker submission models. CrowdBwO dynamically determines and utilizes proper worker set(s) and worker submission models for each task under uncertainty to achieve high-performance crowdsourcing. We conducted extensive experiments with synthetic workers and real workers to evaluate CrowdBwO in two specific problem settings. Our extensive experimental results demonstrate that CrowdBwO is significant for real-world crowdsourcing and has a high performance.
Förderung
- JSPS KAKENHI
- CREST
Zitieren
APA
Xiao, Y., Ito, H., Chen, L., & Morishima, A. (2026). Efficient Task Assignment for Multi-Workerset Crowdsourcing with Time and Expense Considerations. The VLDB Journal, 35(3). https://doi.org/10.1007/s00778-026-00969-5
Vancouver
Xiao Y, Ito H, Chen L, Morishima A. Efficient Task Assignment for Multi-Workerset Crowdsourcing with Time and Expense Considerations. The VLDB Journal. 2026;35(3). doi:10.1007/s00778-026-00969-5
BibTeX
@article{Xiao2026,
author = {Xiao, Yunyi and Ito, Hiroyoshi and Chen, Lei and Morishima, Atsuyuki},
title = {Efficient Task Assignment for Multi-Workerset Crowdsourcing with Time and Expense Considerations},
journal = {The VLDB Journal},
year = {2026},
volume = {35},
number = {3},
doi = {10.1007/s00778-026-00969-5}
}
EUVIMED