EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Information-Geometric Selection for Validation-Guided Ensembles of Extreme Learning Machines: The LEA-EELM Framework

Amir Abbas Sabzevari, Hamid Tabatabaee, Mehrdad Jalali

Mathematics · 2026-11-02 · 14 (21) · 3995

DOI: 10.3390/math14213995 ↗

At a glance

Journal article in Mathematics, published online on 2026-11-02. Written by Amir Abbas Sabzevari and 2 co-authors. 40 references. The full text is freely available (open access, CC BY 4.0).

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Extreme learning machines (ELMs) solve output weights in closed form, so an optimized population of ELMs leaves open which members should form the ensemble. We report a controlled comparison of five rules for this selection step inLEA-EELM, where a Lotus Effect Algorithm (LEA) variant generates fuzzy-activation ELM candidates and M=10 members are chosen from a shared top-2M validation shortlist. Two rules are derived from the Fisher information I(β)=H⊤H/σ2 of a candidate’s linear-Gaussian output stage. Because H⊤H is only positive semidefinite and candidates have different hidden layers, F-complementary compares candidates by the Kullback–Leibler divergence between their predictive distributions, not by a Fisher–Rao distance. For F-norm, we prove that, with least-squares output weights, ∥Hβ∥2=∥T∥2−∥T−Hβ∥2, so the rule selects the worst training fits; it is significantly worse than β-norm on three of four regression benchmarks. F-complementary performs like greedy validation selection and is never significantly better. The information-geometric rules therefore add no measured benefit; the gains come from validation-guided greedy selection, which lowers test RMSE on three of four regression datasets and raises accuracy only on Satellite and Letter, but not on Letter after duplicate rows are removed. All findings are conditional on the candidate pool of a non-canonical (subtractive-sign) LEA variant.

Cite

APA

Sabzevari, A. A., Tabatabaee, H., & Jalali, M. (2026). Information-Geometric Selection for Validation-Guided Ensembles of Extreme Learning Machines: The LEA-EELM Framework. Mathematics, 14(21), 3995. https://doi.org/10.3390/math14213995

Vancouver

Sabzevari AA, Tabatabaee H, Jalali M. Information-Geometric Selection for Validation-Guided Ensembles of Extreme Learning Machines: The LEA-EELM Framework. Mathematics. 2026;14(21):3995. doi:10.3390/math14213995

BibTeX
@article{Sabzevari2026,
  author = {Sabzevari, Amir Abbas and Tabatabaee, Hamid and Jalali, Mehrdad},
  title = {Information-Geometric Selection for Validation-Guided Ensembles of Extreme Learning Machines: The LEA-EELM Framework},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {21},
  pages = {3995},
  doi = {10.3390/math14213995}
}
Start for free →