EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Transformer-Based Neural Network to Predict Credit Card Default

Zongqi Hu, Chai Kiat Yeo

Electronics · 15.06.2026 · 15 (12) · 2656

DOI: 10.3390/electronics15122656 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 15.06.2026. Verfasst von Zongqi Hu und 1 weiteren Autor:innen. Die Arbeit nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We propose a transformer-based neural network for predicting credit card default using raw multivariate credit data represented as a 2D time series, eliminating the need for manual feature engineering. Unlike existing state-of-the-art (SOTA) tree-based models that rely heavily on handcrafted features, our model leverages self-attention to extract latent temporal patterns directly from the raw data. Evaluated on two real-world datasets, our approach outperforms the popular LightGBM baselines and achieves performance on par with the leading ensemble methods. To further explore if our proposed model can enhance common ensemble methods, we incorporate it into an ensemble together with LightGBM. Experimental results show that the ensemble integrating our proposed transformer-based model outperforms existing ensemble approaches. Designed with deployment in mind, the model architecture is lightweight, generalizable, and maintainable, making it suitable for integration into real-world credit risk pipelines. Our results demonstrate strong practical relevance and a clear path towards scalable deployment in financial applications. In addition, we have built in an optional feature augmentation extension to the proposed model to facilitate hybrid adoption of our model by existing users who are accustomed to engineered features from domain expertise and industry practice. Hence, our model is user-friendly and can leverage hybrid learning to support both user-crafted and model-learned features to improve model performance and deployment.

Zitieren

APA

Hu, Z., & Yeo, C. K. (2026). A Transformer-Based Neural Network to Predict Credit Card Default. Electronics, 15(12), 2656. https://doi.org/10.3390/electronics15122656

Vancouver

Hu Z, Yeo CK. A Transformer-Based Neural Network to Predict Credit Card Default. Electronics. 2026;15(12):2656. doi:10.3390/electronics15122656

BibTeX
@article{Hu2026,
  author = {Hu, Zongqi and Yeo, Chai Kiat},
  title = {A Transformer-Based Neural Network to Predict Credit Card Default},
  journal = {Electronics},
  year = {2026},
  volume = {15},
  number = {12},
  pages = {2656},
  doi = {10.3390/electronics15122656}
}
Kostenlos starten →