Multi-Objective Optimization of Regularized Self-Attention Regression Models Using NSGA-II: A Methodological Framework
Communications of the IBIMA · 03.04.2026
DOI: 10.5171/2025.4646525 ↗Kurz gefasst
Fachartikel in der Zeitschrift Communications of the IBIMA, online erschienen am 03.04.2026. Verfasst von Maja CZYŻEWSKA. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Forecasting financial time series with deep neural networks requires models that are both expressive and well regularized. Regularized Self-Attention Regression (RSAR) is a hybrid architecture that combines LSTM, self-attention and convolutional components with explicit regularization, and has shown promising results in financial price prediction. However, its original formulation relies on a small number of manually selected hyperparameter configurations and a single-objective tuning strategy, which limits its adaptability to datasets with different volatility levels, noise structures and temporal dynamics. This paper addresses that gap by proposing a methodological framework that extends RSAR with multi-objective hyperparameter optimization based on an evolutionary genetic algorithm (NSGA-II). The framework defines a structured decision vector for key architectural and regularization parameters, formulates a bi-objective problem that jointly minimizes validation error and the train–validation gap, and outlines the optimization procedure built on non-dominated sorting, diversity preservation and elitist selection. The contribution is purely methodological: the paper provides a detailed description of the RSAR architecture, the underlying self-attention and regularization mechanisms, and their integration into a multi-objective search procedure. The resulting framework offers an implementation-ready basis for automatically adapting RSAR models to diverse financial markets, explicitly balancing predictive accuracy and overfitting risk. Experimental evaluation is intentionally omitted and will be presented in a subsequent study.
Zitieren
APA
CZYŻEWSKA, M. (2026). Multi-Objective Optimization of Regularized Self-Attention Regression Models Using NSGA-II: A Methodological Framework. Communications of the IBIMA. https://doi.org/10.5171/2025.4646525
Vancouver
CZYŻEWSKA M. Multi-Objective Optimization of Regularized Self-Attention Regression Models Using NSGA-II: A Methodological Framework. Communications of the IBIMA. 2026. doi:10.5171/2025.4646525
BibTeX
@article{CZYEWSKA2026,
author = {CZYŻEWSKA, Maja},
title = {Multi-Objective Optimization of Regularized Self-Attention Regression Models Using NSGA-II: A Methodological Framework},
journal = {Communications of the IBIMA},
year = {2026},
doi = {10.5171/2025.4646525}
}
EUVIMED