EUVIMEDEUVIMED entdecken
ValidierungsstudieOpen Access

Large Language Models for Heterogeneous Data Mining in Liver Disease: Framework Development and Retrospective Validation Study

Haiping Zhang, Xinming Li, Kechi Fang, Yinxue Ma, Lijuan Li, Huiping Yan, Yanmin Liu, Yanhua Yu, Jing Wang

Journal of Medical Internet Research · 04.09.2026 · 28 · e92921-e92921

DOI: 10.2196/92921 ↗

Kurz gefasst

Validierungsstudie in der Zeitschrift Journal of Medical Internet Research, online erschienen am 04.09.2026. Verfasst von Haiping Zhang und 8 weiteren Autor:innen. Beteiligte Einrichtung: Clinical Laboratory Center, Beijing Youan Hospital, Capital Medical University, Beijing, P R China. Hauptthemen laut MEDLINE: Data Mining, Large Language Models, Liver Diseases. Die Arbeit nennt 60 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Differentiating among liver disease entities such as autoimmune liver disease (AILD), drug-induced liver injury (DILI), and chronic hepatitis B (CHB) remains clinically challenging due to overlapping clinical manifestations and nonspecific laboratory findings. Conventional machine learning (ML) approaches rely mainly on structured laboratory data, whereas free-text clinical reports and other heterogeneous electronic medical record data are often underused. Large language models (LLMs) may provide a strategy for encoding heterogeneous clinical information, yet their usefulness for liver disease classification remains insufficiently evaluated.

Objective

This study aimed to evaluate the usefulness of LLM-derived embeddings for clinical data mining in liver disease and to determine whether integrating these embeddings with laboratory variables improves classification across broad disease categories and closely related subtypes.

Methods

We retrospectively analyzed electronic medical record data from 7543 patients with nonoverlapping liver disease etiologies treated at Beijing Youan Hospital, Capital Medical University, between 2010 and 2025. Three LLMs (Qwen3, Huatuo-o1, and II-Medical) generated semantic embeddings from standardized clinical text, combining free-text examination reports, and structured clinical observations. Performance was assessed in a 3-class etiological task (AILD, DILI, and CHB) and a 4-class task further subclassifying AILD into autoimmune hepatitis and primary biliary cholangitis. We compared embedding-only models, LLM-integrated ML models, and an ML-only baseline using the same structured variable set and preprocessing pipeline, with lightweight natural language processing encoders and zero-shot LLM reasoning as additional comparators. Models were developed using 5-fold cross-validation and evaluated on an internal holdout set using accuracy, macroaveraged precision, recall, and F 1 -score.

Results

In the 3-class task, the LLM-integrated ML models achieved macro F 1 -scores of 0.835‐0.837, compared with 0.791 for the ML-only baseline, with corresponding accuracies of 0.925‐0.929 versus 0.893. In the 4-class task, the LLM-integrated ML models achieved macro F 1 -scores of 0.717‐0.734, compared with 0.665 for the ML-only baseline, with corresponding accuracies of 0.920‐0.922 versus 0.874. A temporal split sensitivity analysis using cases from 2010 to 2019 for training and cases from 2020 to 2025 for testing showed that the relative advantage of LLM-integrated ML models over the ML-only baseline was preserved. Direct zero-shot LLM reasoning and lightweight natural language processing encoders performed below the embedding-based integrated models.

Conclusions

In this single-center retrospective cohort of patients with clear-cut, nonoverlapping liver disease etiologies, LLM-derived embeddings provided complementary information to structured laboratory variables for multiclass liver disease classification. The integrated framework showed improved internal validation performance compared with the ML-only model, particularly for non-CHB categories and fine-grained subtype discrimination. Because patients with overlapping liver disease etiologies were excluded, the reported performance may overestimate diagnostic accuracy in broader real-world clinical settings where overlapping syndromes are common. Multicenter external validation and prospective evaluation in more heterogeneous patient populations are needed before clinical implementation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Data MiningLarge Language ModelsLiver DiseasesHumansRetrospective StudiesElectronic Health RecordsMachine LearningFemaleNatural Language ProcessingMale

Stichwörter der Autor:innen

LLMsclinical data miningelectronic medical recordslarge language modelsliver diseasenatural language processing

Autor:innen und Institutionen

  • Clinical Laboratory Center, Beijing Youan Hospital, Capital Medical University, Beijing, P R China.
  • Clinical Research Center for Autoimmune Liver Disease, Beijing Youan Hospital, Capital Medical University, Beijing, P R China.
  • State Key Laboratory of Cognitive Science and Mental Health, Institute of Psychology, Chinese Academy of Sciences, No. 16, Lincui Road, Chaoyang District, Beijing, 100101, P R China, 86 10-64855841.
  • Department of Psychology, University of Chinese Academy of Sciences, Beijing, P R China.
  • Second Department of Liver Disease Center, Beijing Youan Hospital, Capital Medical University, Beijing, P R China.

Zitieren

APA

Zhang, H., Li, X., Fang, K., Ma, Y., Li, L., Yan, H., Liu, Y., Yu, Y., & Wang, J. (2026). Large Language Models for Heterogeneous Data Mining in Liver Disease: Framework Development and Retrospective Validation Study. Journal of Medical Internet Research, 28, e92921-e92921. https://doi.org/10.2196/92921

Vancouver

Zhang H, Li X, Fang K, Ma Y, Li L, Yan H, et al. Large Language Models for Heterogeneous Data Mining in Liver Disease: Framework Development and Retrospective Validation Study. Journal of Medical Internet Research. 2026;28:e92921-e92921. doi:10.2196/92921

BibTeX
@article{Zhang2026,
  author = {Zhang, Haiping and Li, Xinming and Fang, Kechi and Ma, Yinxue and Li, Lijuan and Yan, Huiping and Liu, Yanmin and Yu, Yanhua and Wang, Jing},
  title = {Large Language Models for Heterogeneous Data Mining in Liver Disease: Framework Development and Retrospective Validation Study},
  journal = {Journal of Medical Internet Research},
  year = {2026},
  volume = {28},
  pages = {e92921--e92921},
  doi = {10.2196/92921}
}
Kostenlos starten →