Entropy Guided Benchmarking of Classical and Generative Imputation Methods for High-Dimensional Healthcare Survey Data
Applied Sciences · 27.04.2026 · 16 (9) · 4262
DOI: 10.3390/app16094262 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 27.04.2026. Verfasst von Deepa Fernandes Prabhu und 2 weiteren Autor:innen. Die Arbeit nennt 63 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Missing data are a persistent challenge in large healthcare datasets, often undermining both statistical validity and machine learning performance when handled using simplistic assumptions. In this work, we examine how entropy-based diagnostics can guide the selection of imputation strategies for high-dimensional health survey data using the National Health and Nutrition Examination Survey (NHANES) 2021–2023. Shannon entropy is used to identify variables with structurally complex missingness, and a range of classical approaches (mean imputation, k-nearest neighbors, and multiple imputation by chained equations) are evaluated alongside deep generative methods, including variational autoencoders, generative adversarial networks (GANs), Wasserstein GANs (WGANs), and diffusion-based models. All methods are compared under a controlled masked-entry evaluation using root mean square error (RMSE) and Kolmogorov–Smirnov (KS) statistics to capture both reconstruction accuracy and distributional fidelity. Results show that diffusion-based models provide the most consistent balance between numerical accuracy and distributional preservation across high-entropy dietary variables, while WGAN demonstrates competitive performance for selected distributions. Structural equation modeling further indicates that entropy is a useful diagnostic signal for identifying variables that are difficult to reconstruct. Overall, this study provides a reproducible framework for aligning imputation strategy with missingness complexity in healthcare data, with implications for improving reliability in downstream analytics.
Zitieren
APA
Prabhu, D. F., Park, J., & Gurupur, V. P. (2026). Entropy Guided Benchmarking of Classical and Generative Imputation Methods for High-Dimensional Healthcare Survey Data. Applied Sciences, 16(9), 4262. https://doi.org/10.3390/app16094262
Vancouver
Prabhu DF, Park J, Gurupur VP. Entropy Guided Benchmarking of Classical and Generative Imputation Methods for High-Dimensional Healthcare Survey Data. Applied Sciences. 2026;16(9):4262. doi:10.3390/app16094262
BibTeX
@article{Prabhu2026,
author = {Prabhu, Deepa Fernandes and Park, Jaeyoung and Gurupur, Varadraj P.},
title = {Entropy Guided Benchmarking of Classical and Generative Imputation Methods for High-Dimensional Healthcare Survey Data},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {9},
pages = {4262},
doi = {10.3390/app16094262}
}
EUVIMED