A Traditional Chinese Medicine Knowledge Graph for Hypertension With Emotional Comorbidity: Development and Blinded Question-Answering Evaluation (Preprint)
JMIR Medical Informatics · 2026-05-17
DOI: 10.2196/101606 ↗At a glance
Journal article in JMIR Medical Informatics, published online on 2026-05-17. Written by Xiangyu Su and 3 co-authors. Institution: Wenhua xi Road 107#, Qilu Hospital of Shandong University, Jinan Wenhua xi Road 107#, Jinan, CN. 12 references.
Abstract (original language)
BACKGROUND: Traditional Chinese medicine (TCM) literature on hypertension with anxiety, depression, or insomnia contains descriptions of syndrome patterns, treatment principles, formulas, and herbs. A focused knowledge graph can organize these associations and their sources, but its contribution to generated answers requires separate evaluation. OBJECTIVE: To construct a TCM knowledge resource for hypertension with emotional comorbidity, assess a reviewed subset of curated relations, and evaluate the associated question-answering implementation, including the incremental effect of graph retrieval with a fixed generation model. METHODS: Qwen2.5-7B-Instruct generated candidates from the titles, keywords, and abstracts of 419 Chinese-language records, followed by expert curation with textbook and theoretical supplementation. Expert validation was restricted to the 80 relations present in the released graph from an earlier 100-relation review sample. Three clinicians external to construction authored 73 questions, and two additional clinicians blindly rated anonymized responses using a prespecified four-category rubric. Evaluations included retrieval-only and model-only controls, generation-model comparisons, and six retrieval configurations. An additional matched DeepSeek-V4-Pro experiment generated one response per question per condition with and without graph retrieval. Strict correctness was compared using the exact two-sided McNemar test; partial correctness and recorded safety concerns were reported separately. RESULTS: The resource contained 956 indexed terms, 101 graph nodes, and 312 relations with recorded source attribution. Experts confirmed 79/80 reviewed relations present in the released graph (98.8%, 95% CI 93.3%-99.8%); 274/312 final relations were absent from the extraction output. In the matched experiment, strict accuracy was 50/73 (68%, 95% CI 57%-78%) with graph retrieval and 57/73 (78%, 95% CI 67%-86%) without it. Three discordant pairs favored graph assistance and 10 favored model-only generation (P=.09). Partially correct responses numbered 22/73 (30%) and 15/73 (21%), respectively. Both conditions had 72/73 correct-or-partially-correct responses (99%); the same question had a recorded potential safety concern in both conditions. In the separate generation-model rating round with graph retrieval, strict accuracy was 9/73 (12%) for Qwen and 26/73 (36%) for DeepSeek. CONCLUSIONS: The curated graph provides structured, inspectable domain knowledge with source attribution; expert confirmation applies to the reviewed subset of released relations. The matched experiment did not demonstrate improved strict answer accuracy from graph retrieval and did not establish equivalence. The resource and evaluations provide a basis for targeted development; benefits for literature navigation and clinical use require direct validation.
Authors and institutions
- Wenhua xi Road 107#, Qilu Hospital of Shandong University, Jinan Wenhua xi Road 107#, Jinan, CN.
- Affiliated Hospital of Shandong University of Traditional Chinese Medicine, Jinan, CN.
- Shandong University of Traditional Chinese Medicine, Jinan Shandong wenhua xi road, Jinan, CN.
Cite
APA
Su, X., Zhao, X., Yao, G., & Wang, Y. (2026). A Traditional Chinese Medicine Knowledge Graph for Hypertension With Emotional Comorbidity: Development and Blinded Question-Answering Evaluation (Preprint). JMIR Medical Informatics. https://doi.org/10.2196/101606
Vancouver
Su X, Zhao X, Yao G, Wang Y. A Traditional Chinese Medicine Knowledge Graph for Hypertension With Emotional Comorbidity: Development and Blinded Question-Answering Evaluation (Preprint). JMIR Medical Informatics. 2026. doi:10.2196/101606
BibTeX
@article{Su2026,
author = {Su, Xiangyu and Zhao, Xiaoxia and Yao, Guixiang and Wang, Yu},
title = {A Traditional Chinese Medicine Knowledge Graph for Hypertension With Emotional Comorbidity: Development and Blinded Question-Answering Evaluation (Preprint)},
journal = {JMIR Medical Informatics},
year = {2026},
doi = {10.2196/101606}
}
EUVIMED