EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hierarchical & Shrinkage Thompson Sampling for Stable Off-Policy Evaluation On MIMIC-IV

Qianruo Tan

Academic Journal of Science and Technology · 13.03.2026 · 19 (3) · 260-268

DOI: 10.54097/wg8eta78 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Academic Journal of Science and Technology, online erschienen am 13.03.2026. Verfasst von Qianruo Tan. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Trial-and-error is costly in intensive care. Clinicians face high-stakes, noisy decisions where experimentation is risky. We study how to make Thompson Sampling (TS) reliably evaluable offline before deployment. We introduce two variants—Hierarchical Empirical-Bayes TS and Hierarchical Shrinkage TS—that share information by using log across arms to stabilize exploration, especially in early stage. To enable fair and high-power improvement, we adopt an ε-mix shared-log design that improves action overlap while keeping a fixed log for all target policies. Off-policy evaluation uses Inverse Propensity Scoring with weight diagnostics, with effective sample size, upper quantiles, max, and paired bootstrap over seeds for uncertainty. On synthetic data and MIMIC-IV with 6-hour grid setting. Our pipeline yields small but consistent gains over standard TS together with healthy weight distributions and large effective sample sizes. Without ε-mix, early exploration is imbalanced and IPS becomes unstable. Overall, coverage-aware logging plus hierarchical and shrinkage priors provides a reproducible pathway to assess TS policies safely and credibly for ICU decision support.

Zitieren

APA

Tan, Q. (2026). Hierarchical & Shrinkage Thompson Sampling for Stable Off-Policy Evaluation On MIMIC-IV. Academic Journal of Science and Technology, 19(3), 260-268. https://doi.org/10.54097/wg8eta78

Vancouver

Tan Q. Hierarchical & Shrinkage Thompson Sampling for Stable Off-Policy Evaluation On MIMIC-IV. Academic Journal of Science and Technology. 2026;19(3):260-268. doi:10.54097/wg8eta78

BibTeX
@article{Tan2026,
  author = {Tan, Qianruo},
  title = {Hierarchical & Shrinkage Thompson Sampling for Stable Off-Policy Evaluation On MIMIC-IV},
  journal = {Academic Journal of Science and Technology},
  year = {2026},
  volume = {19},
  number = {3},
  pages = {260--268},
  doi = {10.54097/wg8eta78}
}
Kostenlos starten →