Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Trustworthy Response Generation in Chinese
ACM Transactions on Knowledge Discovery from Data · 28.02.2025 · 19 (2) · 1-17
DOI: 10.1145/3686807 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Knowledge Discovery from Data, online erschienen am 14.02.2025. Verfasst von Haochun Wang und 8 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 48 Literaturangaben. Gefördert von: National Key R & D Program of China, National Natural Science Foundation of China Youth Fund, Heilongjiang Provincial Natural Science Foundation of China.
Abstract (Originalsprache)
Large Language Models (LLMs) have demonstrated remarkable success in diverse natural language processing (NLP) tasks in general domains. However, LLMs sometimes generate responses with the hallucination about medical facts due to limited domain knowledge. Such shortcomings pose potential risks in the utilization of LLMs within medical contexts. To address this challenge, we propose knowledge-tuning, which leverages structured medical knowledge bases for the LLMs to grasp domain knowledge efficiently and facilitate trustworthy response generation. We also release cMedKnowQA, a Chinese medical knowledge question-answering dataset constructed from medical knowledge bases to assess the medical knowledge proficiency of LLMs. Experimental results show that the LLMs which are knowledge-tuned with cMedKnowQA can exhibit higher levels of accuracy in response generation compared with vanilla instruction-tuning and offer a new trustworthy way for the domain adaptation of LLMs. We release our code and data at https://github.com/SCIR-HI/Huatuo-Llama-Med-Chinese .
Förderung
- National Key R & D Program of China
- National Natural Science Foundation of China Youth Fund
- Heilongjiang Provincial Natural Science Foundation of China
- Du Xiaoman Technology
Zitieren
APA
Wang, H., Zhao, S., Qiang, Z., Li, Z., Liu, C., Xi, N., Du, Y., Qin, B., & Liu, T. (2025). Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Trustworthy Response Generation in Chinese. ACM Transactions on Knowledge Discovery from Data, 19(2), 1-17. https://doi.org/10.1145/3686807
Vancouver
Wang H, Zhao S, Qiang Z, Li Z, Liu C, Xi N, et al. Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Trustworthy Response Generation in Chinese. ACM Transactions on Knowledge Discovery from Data. 2025;19(2):1-17. doi:10.1145/3686807
BibTeX
@article{Wang2025,
author = {Wang, Haochun and Zhao, Sendong and Qiang, Zewen and Li, Zijian and Liu, Chi and Xi, Nuwa and Du, Yanrui and Qin, Bing and Liu, Ting},
title = {Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Trustworthy Response Generation in Chinese},
journal = {ACM Transactions on Knowledge Discovery from Data},
year = {2025},
volume = {19},
number = {2},
pages = {1--17},
doi = {10.1145/3686807}
}
EUVIMED