Hierarchical & Shrinkage Thompson Sampling for Stable Off-Policy Evaluation On MIMIC-IV
Academic Journal of Science and Technology · 13.03.2026 · 19 (3) · 260-268
DOI: 10.54097/wg8eta78 ↗Kurz gefasst
Fachartikel in der Zeitschrift Academic Journal of Science and Technology, online erschienen am 13.03.2026. Verfasst von Qianruo Tan. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Trial-and-error is costly in intensive care. Clinicians face high-stakes, noisy decisions where experimentation is risky. We study how to make Thompson Sampling (TS) reliably evaluable offline before deployment. We introduce two variants—Hierarchical Empirical-Bayes TS and Hierarchical Shrinkage TS—that share information by using log across arms to stabilize exploration, especially in early stage. To enable fair and high-power improvement, we adopt an ε-mix shared-log design that improves action overlap while keeping a fixed log for all target policies. Off-policy evaluation uses Inverse Propensity Scoring with weight diagnostics, with effective sample size, upper quantiles, max, and paired bootstrap over seeds for uncertainty. On synthetic data and MIMIC-IV with 6-hour grid setting. Our pipeline yields small but consistent gains over standard TS together with healthy weight distributions and large effective sample sizes. Without ε-mix, early exploration is imbalanced and IPS becomes unstable. Overall, coverage-aware logging plus hierarchical and shrinkage priors provides a reproducible pathway to assess TS policies safely and credibly for ICU decision support.
Zitieren
APA
Tan, Q. (2026). Hierarchical & Shrinkage Thompson Sampling for Stable Off-Policy Evaluation On MIMIC-IV. Academic Journal of Science and Technology, 19(3), 260-268. https://doi.org/10.54097/wg8eta78
Vancouver
Tan Q. Hierarchical & Shrinkage Thompson Sampling for Stable Off-Policy Evaluation On MIMIC-IV. Academic Journal of Science and Technology. 2026;19(3):260-268. doi:10.54097/wg8eta78
BibTeX
@article{Tan2026,
author = {Tan, Qianruo},
title = {Hierarchical & Shrinkage Thompson Sampling for Stable Off-Policy Evaluation On MIMIC-IV},
journal = {Academic Journal of Science and Technology},
year = {2026},
volume = {19},
number = {3},
pages = {260--268},
doi = {10.54097/wg8eta78}
}
EUVIMED