EUVIMEDScopri EUVIMED
Crossref

A Concave Pairwise Fusion Approach to Heterogeneous Q‐Learning for Dynamic Treatment Regimes

Jubo Sun, Wensheng Zhu iD, Guozhe Sun iD

Statistics in Medicine · 2026

DOI: 10.1002/sim.70415 ↗

At a glance

Journal article in Statistics in Medicine, 2026. Written by Jubo Sun and 2 co-authors. Institution: Key Laboratory for Applied Statistics of MOE and School of Mathematics and Statistics, Northeast Normal University, Changchun, China. Major MEDLINE topics: Models, Statistical. 39 references. Funded by: National Natural Science Foundation of China, National Key Research and Development Program of China.

AbstractSubjectsDati bibliograficiCiteRelated studies

Abstract (original language)

A dynamic treatment regime is a sequence of decision rules that map available history information to a treatment option at each decision point. The optimal dynamic treatment regime seeks to make these decisions to maximize the expected outcome of interest. Most existing methods assume population homogeneity. In many complex applications, ignoring latent heterogeneous structures may compromise estimation, highlighting the necessity of exploring heterogeneous structures during the estimation of optimal treatment regimes. We propose heterogeneous Q‐learning that facilitates the estimation of optimal dynamic treatment regimes using a concave pairwise fusion penalized approach. The proposed method employs an alternating direction method of multipliers algorithm to solve the concave pairwise fusion penalized least squares problem in each stage. Simulation studies demonstrate that our proposed method outperforms the standard Q‐learning method, and it is further illustrated through a real data analysis from the China Rural Hypertension Control Project (CRHCP) study group.

Subjects

MeSH terms (MEDLINE)

Models, StatisticalHumansComputer SimulationAlgorithmsHypertensionChinaLeast-Squares Analysis

Author keywords

concave pairwise fusion penaltydynamic treatment regimesheterogeneous Q‐learning

Authors and institutions

  • Key Laboratory for Applied Statistics of MOE and School of Mathematics and Statistics, Northeast Normal University, Changchun, China.
  • Department of Mathematics, Jilin Engineering Normal University, Changchun, China.
  • Department of Cardiology, The First Hospital of China Medical University, Shenyang, China.

ORCID profiles: Wensheng Zhu, Guozhe Sun

Funding

  • National Natural Science Foundation of China
  • National Key Research and Development Program of China

Cite

APA

Sun, J., Zhu, W., & Sun, G. (2026). A Concave Pairwise Fusion Approach to Heterogeneous Q‐Learning for Dynamic Treatment Regimes. Statistics in Medicine. https://doi.org/10.1002/sim.70415

Vancouver

Sun J, Zhu W, Sun G. A Concave Pairwise Fusion Approach to Heterogeneous Q‐Learning for Dynamic Treatment Regimes. Statistics in Medicine. 2026. doi:10.1002/sim.70415

BibTeX
@article{Sun2026,
  author = {Sun, Jubo and Zhu, Wensheng and Sun, Guozhe},
  title = {A Concave Pairwise Fusion Approach to Heterogeneous Q‐Learning for Dynamic Treatment Regimes},
  journal = {Statistics in Medicine},
  year = {2026},
  doi = {10.1002/sim.70415}
}
Start for free →