EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

A Novel Variant of LSTM Stock Prediction Method Incorporating Attention Mechanism

Shuai Sang, Lu Li

Mathematics · 2024-03-22 · 12 (7) · 945

DOI: 10.3390/math12070945 ↗

At a glance

Journal article in Mathematics, published online on 2024-03-22. Written by Shuai Sang and 1 co-authors. Cited 81 times so far (Crossref); 26 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Natural Science Foundation of China, Shanghai University of Engineering Science Horizontal Research Project.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Long Short-Term Memory (LSTM) is an effective method for stock price prediction. However, due to the nonlinear and highly random nature of stock price fluctuations over time, LSTM exhibits poor stability and is prone to overfitting, resulting in low prediction accuracy. To address this issue, this paper proposes a novel variant of LSTM that couples the forget gate and input gate in the LSTM structure, and adds a “simple” forget gate to the long-term cell state. In order to enhance the generalization ability and robustness of the variant LSTM, the paper introduces an attention mechanism and combines it with the variant LSTM, presenting the Attention Mechanism Variant LSTM (AMV-LSTM) model along with the corresponding backpropagation algorithm. The parameters in AMV-LSTM are updated using the Adam gradient descent method. Experimental results demonstrate that the variant LSTM alleviates the instability and overfitting issues of LSTM, effectively improving prediction accuracy. AMV-LSTM further enhances accuracy compared to the variant LSTM, and compared to AM-LSTM, it exhibits superior generalization ability, accuracy, and convergence capability.

Funding

  • National Natural Science Foundation of China
  • Shanghai University of Engineering Science Horizontal Research Project

Cite

APA

Sang, S., & Li, L. (2024). A Novel Variant of LSTM Stock Prediction Method Incorporating Attention Mechanism. Mathematics, 12(7), 945. https://doi.org/10.3390/math12070945

Vancouver

Sang S, Li L. A Novel Variant of LSTM Stock Prediction Method Incorporating Attention Mechanism. Mathematics. 2024;12(7):945. doi:10.3390/math12070945

BibTeX
@article{Sang2024,
  author = {Sang, Shuai and Li, Lu},
  title = {A Novel Variant of LSTM Stock Prediction Method Incorporating Attention Mechanism},
  journal = {Mathematics},
  year = {2024},
  volume = {12},
  number = {7},
  pages = {945},
  doi = {10.3390/math12070945}
}
Start for free →