EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Primal and Dual Optimization Strategies for Entropy-Based Regression: A Monte Carlo Comparison

Jorge Cabral, Pedro Macedo, Vera Afreixo

Entropy · 06.11.2026 · 28 (11) · 1219

DOI: 10.3390/e28111219 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Entropy, online erschienen am 06.11.2026. Verfasst von Jorge Cabral und 2 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Portuguese Foundation for Science and Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Generalized cross-entropy regression can be formulated as either a constrained primal optimization problem over probability distributions or a dual optimization problem over Lagrange multipliers. Although the two formulations are theoretically equivalent under the conditions considered, their performance depends on the optimization strategy. This study compares two primal and 10 dual routines targeting the generalized maximum entropy (GME) estimator to inform practical optimizer selection. The optimization formulations use the weighted generalized cross-entropy framework, which includes generalized cross-entropy and GME as particular cases. The Portland cement benchmark and 1000 simulated datasets varying sample size, predictor conditioning, and signal-to-noise ratio assess the routines under GME. We compare elapsed time and coefficient-recovery mean squared error (MSE), alongside interface-reported termination, common feasibility checks, and a separate dual-multiplier moment-residual diagnostic. The results reveal substantial differences in computational efficiency but smaller differences in coefficient-estimation accuracy among most routines. dual.lbfgsb3c has the lowest median time, while dual.BFGS combines competitive time and coefficient recovery and was selected as GCEstim’s default. Coefficient recovery and reported termination should be considered alongside numerical residuals. The comparison reflects a practical use case in which users do not tune each optimizer separately, yet relative performance at matched numerical accuracy remains to be established.

Förderung

  • Portuguese Foundation for Science and Technology

Zitieren

APA

Cabral, J., Macedo, P., & Afreixo, V. (2026). Primal and Dual Optimization Strategies for Entropy-Based Regression: A Monte Carlo Comparison. Entropy, 28(11), 1219. https://doi.org/10.3390/e28111219

Vancouver

Cabral J, Macedo P, Afreixo V. Primal and Dual Optimization Strategies for Entropy-Based Regression: A Monte Carlo Comparison. Entropy. 2026;28(11):1219. doi:10.3390/e28111219

BibTeX
@article{Cabral2026,
  author = {Cabral, Jorge and Macedo, Pedro and Afreixo, Vera},
  title = {Primal and Dual Optimization Strategies for Entropy-Based Regression: A Monte Carlo Comparison},
  journal = {Entropy},
  year = {2026},
  volume = {28},
  number = {11},
  pages = {1219},
  doi = {10.3390/e28111219}
}
Kostenlos starten →