EUVIMEDEUVIMED entdecken
Crossref

Distribution Shift Is Key to Learning Invariant Prediction

Hong Zheng, Fei Teng

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (34) · 28812-28820

DOI: 10.1609/aaai.v40i34.40115 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Hong Zheng und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

An interesting phenomenon arises: Empirical Risk Minimization (ERM) sometimes outperforms methods specifically designed for out-of-distribution tasks. This motivates an investigation into the reasons behind such behavior beyond algorithmic design. In this study, we find that one such reason lies in the distribution shift across training domains. A large degree of distribution shift can lead to better performance even under ERM. Specifically, we derive several theoretical and empirical findings demonstrating that distribution shift plays a crucial role in model learning and benefits learning invariant prediction. Firstly, the proposed upper bounds indicate that the degree of distribution shift directly affects the prediction ability of the learned models. If it is large, the models’ ability can increase, approximating invariant prediction models that make stable predictions under arbitrary known or unseen domains; and vice versa. We also prove that, under certain data conditions, ERM solutions can achieve performance comparable to that of invariant prediction models. Secondly, the empirical validation results demonstrated that the predictions of learned models approximate those of Oracle or Optimal models, provided that the degree of distribution shift in the training data increases.

Zitieren

APA

Zheng, H., & Teng, F. (2026). Distribution Shift Is Key to Learning Invariant Prediction. Proceedings of the AAAI Conference on Artificial Intelligence, 40(34), 28812-28820. https://doi.org/10.1609/aaai.v40i34.40115

Vancouver

Zheng H, Teng F. Distribution Shift Is Key to Learning Invariant Prediction. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(34):28812-28820. doi:10.1609/aaai.v40i34.40115

BibTeX
@article{Zheng2026,
  author = {Zheng, Hong and Teng, Fei},
  title = {Distribution Shift Is Key to Learning Invariant Prediction},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {34},
  pages = {28812--28820},
  doi = {10.1609/aaai.v40i34.40115}
}
Kostenlos starten →