Internal Validity‐Gated Dual Weighting: Toward Target Validity in the Synthesis of Randomized Controlled Trials and Real‐World Studies
Journal of Evidence-Based Medicine · 2026
DOI: 10.1111/jebm.70172 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Evidence-Based Medicine, 2026. Verfasst von Lin Li und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biostatistics, School of Public Health, Southern Medical University, Guangzhou, China. Hauptthemen laut MEDLINE: Randomized Controlled Trials as Topic, Research Design. Die Arbeit nennt 57 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Hainan Province Science and Technology Special Fund.
Abstract (Originalsprache)
Aim
Integrating randomized controlled trials (RCTs) and real‐world studies (RWS) requires balancing internal and external validity to achieve target validity. We extended external validity assessment to better capture contextual complexity and diversity, integrating it with established internal validity tools to refine the target validity scoring system. Then, we proposed an Internal Validity‐Gated Dual Weighting (IVDW) strategy, which applies external validity weights to studies exceeding a predefined internal validity threshold.
Methods
The scoring system was refined through a two‐round Delphi process and Analytic Hierarchy Process to ensure content validity and derive item weights. IVDW was implemented in both frequentist and Bayesian frameworks and compared with four alternatives: Equal‐Weighting, Dual‐dimensional Weighting (DDW), Conditional Exclusion‐based Dual‐weighting (CEDW), and Internal‐validity‐Only Weighting (IVOW), in a novel synthesis of neoadjuvant chemoimmunotherapy in older adults with non‐small cell lung cancer.
Results
Studies with concurrently high internal and external validity had risk difference estimates below 0.2. IVDW more effectively downweighted low‐internal‐validity studies than DDW and reduced reliance on low‐external‐validity studies compared to IVOW. It improved interpretability by explicitly balancing validity dimensions while maintaining higher evidence inclusion than CEDW. When combined with the quality effects model, IVDW produced estimates aligned with high target validity studies.
Conclusions
The proposed target validity scoring system, combined with the IVDW strategy, steers effect estimates toward studies with higher internal and external validity. It extends a novel perspective for evidence synthesis and enhances the external validity of meta‐analytic findings in real‐world clinical decision‐making.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biostatistics, School of Public Health, Southern Medical University, Guangzhou, China.
- Department of Endocrinology and Metabolism, MAGIC China Center, West China Hospital of Sichuan University, Chengdu, China.
- Department of Biostatistics and Bioinformatics, Duke University School of Medicine, Durham, USA.
- Center for Price and Procurement Guidance, National Healthcare Security Administration, Beijing, China.
- China Center for Food and Drug International Exchange, Beijing, China.
Förderung
- National Natural Science Foundation of China
- Hainan Province Science and Technology Special Fund
Zitieren
APA
Li, L., Liu, Y., Wu, Z., Liao, Y., Li, S., Chow, S. C., Liao, B., Zhang, D., Xie, Z., & Wu, Y. (2026). Internal Validity‐Gated Dual Weighting: Toward Target Validity in the Synthesis of Randomized Controlled Trials and Real‐World Studies. Journal of Evidence-Based Medicine. https://doi.org/10.1111/jebm.70172
Vancouver
Li L, Liu Y, Wu Z, Liao Y, Li S, Chow SC, et al. Internal Validity‐Gated Dual Weighting: Toward Target Validity in the Synthesis of Randomized Controlled Trials and Real‐World Studies. Journal of Evidence-Based Medicine. 2026. doi:10.1111/jebm.70172
BibTeX
@article{Li2026,
author = {Li, Lin and Liu, Yinuo and Wu, Zhuotong and Liao, Yuqi and Li, Sheyu and Chow, Shein-Chung and Liao, Binchi and Zhang, Dingheng and Xie, Zhangshu and Wu, Ying},
title = {Internal Validity‐Gated Dual Weighting: Toward Target Validity in the Synthesis of Randomized Controlled Trials and Real‐World Studies},
journal = {Journal of Evidence-Based Medicine},
year = {2026},
doi = {10.1111/jebm.70172}
}
EUVIMED