A Transformer-Based Neural Network to Predict Credit Card Default
Electronics · 15.06.2026 · 15 (12) · 2656
DOI: 10.3390/electronics15122656 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 15.06.2026. Verfasst von Zongqi Hu und 1 weiteren Autor:innen. Die Arbeit nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
We propose a transformer-based neural network for predicting credit card default using raw multivariate credit data represented as a 2D time series, eliminating the need for manual feature engineering. Unlike existing state-of-the-art (SOTA) tree-based models that rely heavily on handcrafted features, our model leverages self-attention to extract latent temporal patterns directly from the raw data. Evaluated on two real-world datasets, our approach outperforms the popular LightGBM baselines and achieves performance on par with the leading ensemble methods. To further explore if our proposed model can enhance common ensemble methods, we incorporate it into an ensemble together with LightGBM. Experimental results show that the ensemble integrating our proposed transformer-based model outperforms existing ensemble approaches. Designed with deployment in mind, the model architecture is lightweight, generalizable, and maintainable, making it suitable for integration into real-world credit risk pipelines. Our results demonstrate strong practical relevance and a clear path towards scalable deployment in financial applications. In addition, we have built in an optional feature augmentation extension to the proposed model to facilitate hybrid adoption of our model by existing users who are accustomed to engineered features from domain expertise and industry practice. Hence, our model is user-friendly and can leverage hybrid learning to support both user-crafted and model-learned features to improve model performance and deployment.
Zitieren
APA
Hu, Z., & Yeo, C. K. (2026). A Transformer-Based Neural Network to Predict Credit Card Default. Electronics, 15(12), 2656. https://doi.org/10.3390/electronics15122656
Vancouver
Hu Z, Yeo CK. A Transformer-Based Neural Network to Predict Credit Card Default. Electronics. 2026;15(12):2656. doi:10.3390/electronics15122656
BibTeX
@article{Hu2026,
author = {Hu, Zongqi and Yeo, Chai Kiat},
title = {A Transformer-Based Neural Network to Predict Credit Card Default},
journal = {Electronics},
year = {2026},
volume = {15},
number = {12},
pages = {2656},
doi = {10.3390/electronics15122656}
}
EUVIMED