LLM-Augmented Linear Transformer–CNN for Enhanced Stock Price Prediction
Mathematics · 31.01.2025 · 13 (3) · 487
DOI: 10.3390/math13030487 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 31.01.2025. Verfasst von Lei Zhou und 6 weiteren Autor:innen. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Accurately predicting stock prices remains a challenging task due to the volatile and complex nature of financial markets. In this study, we propose a novel hybrid deep learning framework that integrates a large language model (LLM), a Linear Transformer (LT), and a Convolutional Neural Network (CNN) to enhance stock price prediction using solely historical market data. The framework leverages the LLM as a professional financial analyst to perform daily technical analysis. The technical indicators, including moving averages (MAs), relative strength index (RSI), and Bollinger Bands (BBs), are calculated directly from historical stock data. These indicators are then analyzed by the LLM, generating descriptive textual summaries. The textual summaries are further transformed into vector representations using FinBERT, a pre-trained financial language model, to enhance the dataset with contextual insights. The FinBERT embeddings are integrated with features from two additional branches: the Linear Transformer branch, which captures long-term dependencies in time-series stock data through a linearized self-attention mechanism, and the CNN branch, which extracts spatial features from visual representations of stock chart data. The combined features from these three modalities are then processed by a Feedforward Neural Network (FNN) for final stock price prediction. Experimental results on the S&P 500 dataset demonstrate that the proposed framework significantly improves stock prediction accuracy by effectively capturing temporal, spatial, and contextual dependencies in the data. This multimodal approach highlights the importance of integrating advanced technical analysis with deep learning architectures for enhanced financial forecasting.
Zitieren
APA
Zhou, L., Zhang, Y., Yu, J., Wang, G., Liu, Z., Yongchareon, S., & Wang, N. (2025). LLM-Augmented Linear Transformer–CNN for Enhanced Stock Price Prediction. Mathematics, 13(3), 487. https://doi.org/10.3390/math13030487
Vancouver
Zhou L, Zhang Y, Yu J, Wang G, Liu Z, Yongchareon S, et al. LLM-Augmented Linear Transformer–CNN for Enhanced Stock Price Prediction. Mathematics. 2025;13(3):487. doi:10.3390/math13030487
BibTeX
@article{Zhou2025,
author = {Zhou, Lei and Zhang, Yuqi and Yu, Jian and Wang, Guiling and Liu, Zhizhong and Yongchareon, Sira and Wang, Nancy},
title = {LLM-Augmented Linear Transformer–CNN for Enhanced Stock Price Prediction},
journal = {Mathematics},
year = {2025},
volume = {13},
number = {3},
pages = {487},
doi = {10.3390/math13030487}
}
EUVIMED