Learning From Crowdsourced Noisy Labels: A signal processing perspective
IEEE Signal Processing Magazine · 2025-05 · 42 (3) · 84-106
DOI: 10.1109/msp.2025.3572636 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Signal Processing Magazine, 2025-05. Verfasst von Shahana Ibrahim und 3 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 77 Literaturangaben. Gefördert von: NSF.
Abstract (Originalsprache)
One of the primary catalysts fueling advances in artificial intelligence (AI) and machine learning (ML) is the availability of massive, curated datasets. A commonly used technique to curate such massive datasets is crowdsourcing, where data are dispatched to multiple annotators. The annotatorproduced labels are then fused to serve downstream learning and inference tasks. This annotation process often creates noisy labels due to various reasons, such as the limited expertise, or unreliability of annotators, among others. Therefore, a core objective in crowdsourcing is to develop methods that effectively mitigate the negative impact of such label noise on learning tasks. This feature article introduces advances in learning from noisy crowdsourced labels. The focus is on key crowdsourcing models and their methodological treatments, from classical statistical models to recent deep learningbased approaches, emphasizing analytical insights and algorithmic developments. In particular, this article reviews the connections between signal processing (SP) theory and methods, such as identifiability of tensor and nonnegative matrix factorization, and novel, principled solutions of longstanding challenges in crowdsourcing—showing how SP perspectives drive the advancements of this field. Furthermore, this article touches upon emerging topics that are critical for developing cutting-edge AI/ML systems, such as crowdsourcing in reinforcement learning with human feedback (RLHF) and direct preference optimization (DPO) that are key techniques for fine-tuning large language models (LLMs).
Förderung
- NSF
Zitieren
APA
Ibrahim, S., Traganitis, P. A., Fu, X., & Giannakis, G. B. (2025). Learning From Crowdsourced Noisy Labels: A signal processing perspective. IEEE Signal Processing Magazine, 42(3), 84-106. https://doi.org/10.1109/msp.2025.3572636
Vancouver
Ibrahim S, Traganitis PA, Fu X, Giannakis GB. Learning From Crowdsourced Noisy Labels: A signal processing perspective. IEEE Signal Processing Magazine. 2025;42(3):84-106. doi:10.1109/msp.2025.3572636
BibTeX
@article{Ibrahim2025,
author = {Ibrahim, Shahana and Traganitis, Panagiotis A. and Fu, Xiao and Giannakis, Georgios B.},
title = {Learning From Crowdsourced Noisy Labels: A signal processing perspective},
journal = {IEEE Signal Processing Magazine},
year = {2025},
volume = {42},
number = {3},
pages = {84--106},
doi = {10.1109/msp.2025.3572636}
}
EUVIMED