EUVIMEDEUVIMED entdecken
Crossref

Active Learning with Imperfect Labels: Optimal Labeler Assignment and Sample Selection

Pouya Ahadi, Blair Winograd, Camille Zaug, Karunesh Arora, Lijun Wang, Kamran Paynabar

INFORMS Journal on Data Science · 04.11.2026

DOI: 10.1287/ijds.2025.0105 ↗

Kurz gefasst

Fachartikel in der Zeitschrift INFORMS Journal on Data Science, online erschienen am 04.11.2026. Verfasst von Pouya Ahadi und 5 weiteren Autor:innen. Die Arbeit nennt 34 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Active learning (AL) is commonly used in applications where labeling data are expensive or time consuming. In practice, however, labels are often noisy because of varying labeler expertise and annotation uncertainty, especially for complex or ambiguous samples. Learning from such imperfectly labeled data can degrade classifier performance. We propose an AL framework that explicitly accounts for label noise by optimally assigning labelers and selecting samples to minimize labeling error. Our approach, which is called optimal labeler assignment and sampling (OLAS), uses a noise model that depends on both labeler accuracy and model uncertainty to guide these decisions. We develop two tractable optimization formulations: one for assigning samples to labelers to minimize worst-case noise and another for selecting samples while controlling overall label noise. Theoretical results provide closed-form solutions under mild conditions. Empirical evaluations on benchmark data sets and a real-world warranty claim classification problem show that OLAS achieves the highest or near-highest classification accuracy among existing AL strategies across most settings using only a single label per sample.

Zitieren

APA

Ahadi, P., Winograd, B., Zaug, C., Arora, K., Wang, L., & Paynabar, K. (2026). Active Learning with Imperfect Labels: Optimal Labeler Assignment and Sample Selection. INFORMS Journal on Data Science. https://doi.org/10.1287/ijds.2025.0105

Vancouver

Ahadi P, Winograd B, Zaug C, Arora K, Wang L, Paynabar K. Active Learning with Imperfect Labels: Optimal Labeler Assignment and Sample Selection. INFORMS Journal on Data Science. 2026. doi:10.1287/ijds.2025.0105

BibTeX
@article{Ahadi2026,
  author = {Ahadi, Pouya and Winograd, Blair and Zaug, Camille and Arora, Karunesh and Wang, Lijun and Paynabar, Kamran},
  title = {Active Learning with Imperfect Labels: Optimal Labeler Assignment and Sample Selection},
  journal = {INFORMS Journal on Data Science},
  year = {2026},
  doi = {10.1287/ijds.2025.0105}
}
Kostenlos starten →