EUVIMEDEUVIMED entdecken
Crossref

Modelling with categorical features via exact fusion and sparsity regularization

Kayhan Behdin, Riade Benbaki, Peter Radchenko, Rahul Mazumder

Journal of the Royal Statistical Society Series B: Statistical Methodology · 12.11.2026 · 88 (5) · 1578-1598

DOI: 10.1093/jrsssb/qkag062 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the Royal Statistical Society Series B: Statistical Methodology, online erschienen am 09.04.2026. Verfasst von Kayhan Behdin und 3 weiteren Autor:innen. Die Arbeit nennt 43 Literaturangaben. Gefördert von: Office of Naval Research.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We study the high-dimensional linear regression problem with categorical predictors that have many levels. We propose a new estimation approach, which performs model compression via two mechanisms by simultaneously encouraging (a) clustering of the regression coefficients to collapse some of the categorical levels together; and (b) sparsity of the regression coefficients. We present novel mixed integer programming formulations for our estimator, and develop a custom row generation procedure to speed up the exact off-the-shelf solvers. We also propose a fast approximate algorithm for our method that obtains high-quality feasible solutions via block coordinate descent. As the main building block of our algorithm, we develop an exact algorithm for the univariate case based on dynamic programming, which can be of independent interest. We establish new theoretical guarantees for both the prediction and the cluster recovery performance of our estimator. Our numerical experiments on synthetic and real datasets demonstrate that our proposed estimator tends to outperform the state-of-the-art.

Förderung

  • Office of Naval Research

Zitieren

APA

Behdin, K., Benbaki, R., Radchenko, P., & Mazumder, R. (2026). Modelling with categorical features via exact fusion and sparsity regularization. Journal of the Royal Statistical Society Series B: Statistical Methodology, 88(5), 1578-1598. https://doi.org/10.1093/jrsssb/qkag062

Vancouver

Behdin K, Benbaki R, Radchenko P, Mazumder R. Modelling with categorical features via exact fusion and sparsity regularization. Journal of the Royal Statistical Society Series B: Statistical Methodology. 2026;88(5):1578-1598. doi:10.1093/jrsssb/qkag062

BibTeX
@article{Behdin2026,
  author = {Behdin, Kayhan and Benbaki, Riade and Radchenko, Peter and Mazumder, Rahul},
  title = {Modelling with categorical features via exact fusion and sparsity regularization},
  journal = {Journal of the Royal Statistical Society Series B: Statistical Methodology},
  year = {2026},
  volume = {88},
  number = {5},
  pages = {1578--1598},
  doi = {10.1093/jrsssb/qkag062}
}
Kostenlos starten →