EUVIMEDEUVIMED entdecken
Crossref

Meta-Learning for Dataset Selection: An Adaptive Utility Scoring Framework with Interpretable Meta-Feature Analysis

Faisal AL-Saqqar, Amjad H. Alkilan, Mohammad I. Nusir, Wael AlQassas, Mohammad El-Bashir

International Journal of Advances in Soft Computing and its Applications · 2026

DOI: 10.15849/ijasca.160 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Advances in Soft Computing and its Applications, 2026. Verfasst von Faisal AL-Saqqar und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Dataset selection is commonly based on dataset size, prior experience, or computationally expensive trial-and-error evaluation. We treat that choice as a meta-learning problem instead. The Adaptive Dataset Utility Score (ADUS) ranks candidate datasets without training the downstream classifier portfolio on each candidate, using a scoring function developed from a separate collection of datasets whose classifier performance has already been measured. It reads 31 meta-features covering a dataset's statistics, structure, information content, and complexity, then combines them with weights that are either set by hand or fit to past results using non-negative least squares under a nested leave-one-dataset-out protocol. Across 20 datasets tested against five classifiers, both ADUS variants ranked the true best-performing dataset first in the aggregated leave-one-dataset-out ranking, a result no baseline or learned meta-learner matched, and the default-coefficient variant tracked realised utility at a Spearman correlation of 0.665, against 0.614 for a random forest meta-learner and 0.155 for ranking on sample count. Information-theoretic and complexity-based meta-features contributed most strongly to predictive performance, with the complexity group carrying the single largest share. Unexpectedly, the bell-shaped complexity term in the default formula improved raw ranking correlation when removed, even though it also reduced the fraction of top-performing datasets recovered in the top-3 -- a genuine trade-off documented in the component ablation rather than a reason to drop the term outright.

Zitieren

APA

AL-Saqqar, F., Alkilan, A. H., Nusir, M. I., AlQassas, W., & El-Bashir, M. (2026). Meta-Learning for Dataset Selection: An Adaptive Utility Scoring Framework with Interpretable Meta-Feature Analysis. International Journal of Advances in Soft Computing and its Applications. https://doi.org/10.15849/ijasca.160

Vancouver

AL-Saqqar F, Alkilan AH, Nusir MI, AlQassas W, El-Bashir M. Meta-Learning for Dataset Selection: An Adaptive Utility Scoring Framework with Interpretable Meta-Feature Analysis. International Journal of Advances in Soft Computing and its Applications. 2026. doi:10.15849/ijasca.160

BibTeX
@article{ALSaqqar2026,
  author = {AL-Saqqar, Faisal and Alkilan, Amjad H. and Nusir, Mohammad I. and AlQassas, Wael and El-Bashir, Mohammad},
  title = {Meta-Learning for Dataset Selection: An Adaptive Utility Scoring Framework with Interpretable Meta-Feature Analysis},
  journal = {International Journal of Advances in Soft Computing and its Applications},
  year = {2026},
  doi = {10.15849/ijasca.160}
}
Kostenlos starten →