EUVIMEDEUVIMED entdecken
Crossref

Learning From Crowdsourced Noisy Labels: A signal processing perspective

Shahana Ibrahim, Panagiotis A. Traganitis, Xiao Fu, Georgios B. Giannakis

IEEE Signal Processing Magazine · 2025-05 · 42 (3) · 84-106

DOI: 10.1109/msp.2025.3572636 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Signal Processing Magazine, 2025-05. Verfasst von Shahana Ibrahim und 3 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 77 Literaturangaben. Gefördert von: NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

One of the primary catalysts fueling advances in artificial intelligence (AI) and machine learning (ML) is the availability of massive, curated datasets. A commonly used technique to curate such massive datasets is crowdsourcing, where data are dispatched to multiple annotators. The annotatorproduced labels are then fused to serve downstream learning and inference tasks. This annotation process often creates noisy labels due to various reasons, such as the limited expertise, or unreliability of annotators, among others. Therefore, a core objective in crowdsourcing is to develop methods that effectively mitigate the negative impact of such label noise on learning tasks. This feature article introduces advances in learning from noisy crowdsourced labels. The focus is on key crowdsourcing models and their methodological treatments, from classical statistical models to recent deep learningbased approaches, emphasizing analytical insights and algorithmic developments. In particular, this article reviews the connections between signal processing (SP) theory and methods, such as identifiability of tensor and nonnegative matrix factorization, and novel, principled solutions of longstanding challenges in crowdsourcing—showing how SP perspectives drive the advancements of this field. Furthermore, this article touches upon emerging topics that are critical for developing cutting-edge AI/ML systems, such as crowdsourcing in reinforcement learning with human feedback (RLHF) and direct preference optimization (DPO) that are key techniques for fine-tuning large language models (LLMs).

Förderung

  • NSF

Zitieren

APA

Ibrahim, S., Traganitis, P. A., Fu, X., & Giannakis, G. B. (2025). Learning From Crowdsourced Noisy Labels: A signal processing perspective. IEEE Signal Processing Magazine, 42(3), 84-106. https://doi.org/10.1109/msp.2025.3572636

Vancouver

Ibrahim S, Traganitis PA, Fu X, Giannakis GB. Learning From Crowdsourced Noisy Labels: A signal processing perspective. IEEE Signal Processing Magazine. 2025;42(3):84-106. doi:10.1109/msp.2025.3572636

BibTeX
@article{Ibrahim2025,
  author = {Ibrahim, Shahana and Traganitis, Panagiotis A. and Fu, Xiao and Giannakis, Georgios B.},
  title = {Learning From Crowdsourced Noisy Labels: A signal processing perspective},
  journal = {IEEE Signal Processing Magazine},
  year = {2025},
  volume = {42},
  number = {3},
  pages = {84--106},
  doi = {10.1109/msp.2025.3572636}
}
Kostenlos starten →