Data Leakage and Deceptive Performance: A Critical Examination of Credit Card Fraud Detection Methodologies
Mathematics · 10.08.2025 · 13 (16) · 2563
DOI: 10.3390/math13162563 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 10.08.2025. Verfasst von Khizar Hayat und 1 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This study critically examines the methodological rigor in credit card fraud detection research, revealing how fundamental evaluation flaws can overshadow algorithmic sophistication. Through deliberate experimentation with improper evaluation protocols, we demonstrate that even simple models can achieve deceptively impressive results when basic methodological principles are violated. Our analysis identifies four critical issues plaguing current approaches: (1) pervasive data leakage from improper preprocessing sequences, (2) intentional vagueness in methodological reporting, (3) inadequate temporal validation for transaction data, and (4) metric manipulation through recall optimization at precision’s expense. We present a case study showing how a minimal neural network architecture with data leakage outperforms many sophisticated methods reported in literature, achieving 99.9% recall despite fundamental evaluation flaws. These findings underscore that proper evaluation methodology matters more than model complexity in fraud detection research. The study serves as a cautionary example of how methodological rigor must precede architectural sophistication, with implications for improving research practices across machine learning applications. Compared to several recent studies reporting near-perfect recall (often exceeding 99%) using complex deep models, our corrected evaluation with a simple MLP baseline yields more modest but reliable metrics, exposing the overestimation common in flawed pipelines.
Zitieren
APA
Hayat, K., & Magnier, B. (2025). Data Leakage and Deceptive Performance: A Critical Examination of Credit Card Fraud Detection Methodologies. Mathematics, 13(16), 2563. https://doi.org/10.3390/math13162563
Vancouver
Hayat K, Magnier B. Data Leakage and Deceptive Performance: A Critical Examination of Credit Card Fraud Detection Methodologies. Mathematics. 2025;13(16):2563. doi:10.3390/math13162563
BibTeX
@article{Hayat2025,
author = {Hayat, Khizar and Magnier, Baptiste},
title = {Data Leakage and Deceptive Performance: A Critical Examination of Credit Card Fraud Detection Methodologies},
journal = {Mathematics},
year = {2025},
volume = {13},
number = {16},
pages = {2563},
doi = {10.3390/math13162563}
}
EUVIMED