EUVIMEDEUVIMED entdecken
Crossref

A Theoretical Perspective on Streaming Noisy Data With Distribution Shift

Wenshui Luo, Shuo Chen, Tao Zhou, Chen Gong

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026-04 · 48 (4) · 4150-4166

DOI: 10.1109/tpami.2025.3643174 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026-04. Verfasst von Wenshui Luo und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Shanghai Municipal Science and Technology Major Project, Provincial Natural Science Fund of Jiangsu.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Intelligent systems typically need to continually learn from streaming data subject to distribution shift, where a key requirement is that they cannot catastrophically forget the historical knowledge learned from previous data. More seriously, streaming data often contain substantial label noise, which can exacerbate catastrophic forgetting and lead to performance degradation on forthcoming data. To address these problems, Continual Noisy Label Learning (CNLL) has been proposed. However, existing CNLL methods still fall short of the ability in addressing catastrophic forgetting because they adopted heuristic strategies in handling label noise and did not explicitly characterize the distributional shift across time, which hinders effective knowledge transfer from historical data to new data. To tackle these challenges, we theoretically analyze the problem of learning from streaming noisy data with distribution shift and propose a unified framework called Continual Noisy Label Learning on Drifting Data Streams (CNLDD). Specifically, we theoretically explore, for the first time, the upper bound of cumulative generalization error for CNLL problem, which reveals three factors leading to forgetting, namely selection bias of buffered data, distribution shift, and label noise. To alleviate the selection bias of buffered data, we design a two-step buffer update strategy to narrow the distribution gap between the original historical data and the selected representative data in buffer. To address distribution shift, our CNLDD explicitly characterizes the distribution discrepancies between buffered data and incoming data, prioritizing historical data with minimal discrepancies to enhance knowledge transfer. To tackle noisy labels, CNLDD estimates the importance weight of each example with the instance-dependent noise transition matrix, thereby avoiding the data bias and knowledge forgetting arising from noisy labels. Empirically, due to the unified modeling of the aforementioned issues, our CNLDD achieves superior classification performance when compared with state-of-the-art CNLL methods on both synthetic and real-world datasets.

Förderung

  • National Natural Science Foundation of China
  • Shanghai Municipal Science and Technology Major Project
  • Provincial Natural Science Fund of Jiangsu
  • Suzhou Municipal Leading Talents Fund

Zitieren

APA

Luo, W., Chen, S., Zhou, T., & Gong, C. (2026). A Theoretical Perspective on Streaming Noisy Data With Distribution Shift. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(4), 4150-4166. https://doi.org/10.1109/tpami.2025.3643174

Vancouver

Luo W, Chen S, Zhou T, Gong C. A Theoretical Perspective on Streaming Noisy Data With Distribution Shift. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026;48(4):4150-4166. doi:10.1109/tpami.2025.3643174

BibTeX
@article{Luo2026,
  author = {Luo, Wenshui and Chen, Shuo and Zhou, Tao and Gong, Chen},
  title = {A Theoretical Perspective on Streaming Noisy Data With Distribution Shift},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2026},
  volume = {48},
  number = {4},
  pages = {4150--4166},
  doi = {10.1109/tpami.2025.3643174}
}
Kostenlos starten →