A Concave Pairwise Fusion Approach to Heterogeneous Q‐Learning for Dynamic Treatment Regimes
Statistics in Medicine · 2026
DOI: 10.1002/sim.70415 ↗At a glance
Journal article in Statistics in Medicine, 2026. Written by Jubo Sun and 2 co-authors. Institution: Key Laboratory for Applied Statistics of MOE and School of Mathematics and Statistics, Northeast Normal University, Changchun, China. Major MEDLINE topics: Models, Statistical. 39 references. Funded by: National Natural Science Foundation of China, National Key Research and Development Program of China.
Abstract (original language)
A dynamic treatment regime is a sequence of decision rules that map available history information to a treatment option at each decision point. The optimal dynamic treatment regime seeks to make these decisions to maximize the expected outcome of interest. Most existing methods assume population homogeneity. In many complex applications, ignoring latent heterogeneous structures may compromise estimation, highlighting the necessity of exploring heterogeneous structures during the estimation of optimal treatment regimes. We propose heterogeneous Q‐learning that facilitates the estimation of optimal dynamic treatment regimes using a concave pairwise fusion penalized approach. The proposed method employs an alternating direction method of multipliers algorithm to solve the concave pairwise fusion penalized least squares problem in each stage. Simulation studies demonstrate that our proposed method outperforms the standard Q‐learning method, and it is further illustrated through a real data analysis from the China Rural Hypertension Control Project (CRHCP) study group.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Key Laboratory for Applied Statistics of MOE and School of Mathematics and Statistics, Northeast Normal University, Changchun, China.
- Department of Mathematics, Jilin Engineering Normal University, Changchun, China.
- Department of Cardiology, The First Hospital of China Medical University, Shenyang, China.
ORCID profiles: Wensheng Zhu, Guozhe Sun
Funding
- National Natural Science Foundation of China
- National Key Research and Development Program of China
Cite
APA
Sun, J., Zhu, W., & Sun, G. (2026). A Concave Pairwise Fusion Approach to Heterogeneous Q‐Learning for Dynamic Treatment Regimes. Statistics in Medicine. https://doi.org/10.1002/sim.70415
Vancouver
Sun J, Zhu W, Sun G. A Concave Pairwise Fusion Approach to Heterogeneous Q‐Learning for Dynamic Treatment Regimes. Statistics in Medicine. 2026. doi:10.1002/sim.70415
BibTeX
@article{Sun2026,
author = {Sun, Jubo and Zhu, Wensheng and Sun, Guozhe},
title = {A Concave Pairwise Fusion Approach to Heterogeneous Q‐Learning for Dynamic Treatment Regimes},
journal = {Statistics in Medicine},
year = {2026},
doi = {10.1002/sim.70415}
}
EUVIMED