EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

The best linear sub-model selection with entropy based regularization

Frantisek Voldrich, Jaromir Kukal

Archives of Control Sciences · 25.06.2026 · 36 (2)

DOI: 10.24425/acs.2026.1540 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Archives of Control Sciences, online erschienen am 25.06.2026. Verfasst von Frantisek Voldrich und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper presents a unified framework for linear sub-model selection based on the principle of entropy maximization. By maximizing entropy under suitable constraints, we derive generalized normal distributions that define both the error model and the prior on regression weights, linking distributional assumptions directly to regularization penalties. The resulting quasi-likelihood formulation integrates likelihood maximization with regularization and allows flexible control of robustness and sparsity through two shape parameters. We develop a convex optimization approach for parameter estimation and propose a heuristic binary optimization algorithm for efficient sub-model selection guided by Bayesian Information Criteria (BIC). The framework is experimentally evaluated on simulated regression tasks with both binary and continuous weights under varying noise conditions. The experiments systematically examine the influence of the distributional parameters and on the accuracy and stability of sub-model identification. The results show that for low and moderate noise levels, the proposed method reliably recovers the true sub-model and achieves information criterion values comparable to those of established regularization techniques such as ridge and lasso regression.

Zitieren

APA

Voldrich, F., & Kukal, J. (2026). The best linear sub-model selection with entropy based regularization. Archives of Control Sciences, 36(2). https://doi.org/10.24425/acs.2026.1540

Vancouver

Voldrich F, Kukal J. The best linear sub-model selection with entropy based regularization. Archives of Control Sciences. 2026;36(2). doi:10.24425/acs.2026.1540

BibTeX
@article{Voldrich2026,
  author = {Voldrich, Frantisek and Kukal, Jaromir},
  title = {The best linear sub-model selection with entropy based regularization},
  journal = {Archives of Control Sciences},
  year = {2026},
  volume = {36},
  number = {2},
  doi = {10.24425/acs.2026.1540}
}
Kostenlos starten →