EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

LLM-IE: a python package for biomedical generative information extraction with large language models

Enshuo Hsu iD, Kirk Roberts

JAMIA Open · 06.03.2025 · 8 (2)

DOI: 10.1093/jamiaopen/ooaf012 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JAMIA Open, online erschienen am 12.03.2025. Verfasst von Enshuo Hsu und 1 weiteren Autor:innen. Beteiligte Einrichtung: McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX 77030, United States. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NLM NIH HHS, National Library of Medicine.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Objectives

Despite the recent adoption of large language models (LLMs) for biomedical information extraction (IE), challenges in prompt engineering and algorithms persist, with no dedicated software available. To address this, we developed LLM-IE: a Python package for building complete IE pipelines. Materials and Methods The LLM-IE supports named entity recognition, entity attribute extraction, and relation extraction tasks. We benchmarked it on the i2b2 clinical datasets.

Results

The sentence-based prompting algorithm resulted in the best 8-shot performance of over 70% strict F1 for entity extraction and about 60% F1 for entity attribute extraction.

Discussion

We developed a Python package, LLM-IE, highlighting (1) an interactive LLM agent to support schema definition and prompt design, (2) state-of-the-art prompting algorithms, and (3) visualization features.

Conclusion

The LLM-IE provides essential building blocks for developing robust information extraction pipelines. Future work will aim to expand its features and further optimize computational efficiency.

Schlagwörter

Stichwörter der Autor:innen

information extractionlarge language modelsnamed entity recognitionnatural language processingrelation extraction

Autor:innen und Institutionen

  • McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX 77030, United States.
  • Enterprise Development and Integration, University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States.

ORCID-Profile: Enshuo Hsu

Förderung

  • NLM NIH HHS
  • National Library of Medicine

Zitieren

APA

Hsu, E., & Roberts, K. (2025). LLM-IE: a python package for biomedical generative information extraction with large language models. JAMIA Open, 8(2). https://doi.org/10.1093/jamiaopen/ooaf012

Vancouver

Hsu E, Roberts K. LLM-IE: a python package for biomedical generative information extraction with large language models. JAMIA Open. 2025;8(2). doi:10.1093/jamiaopen/ooaf012

BibTeX
@article{Hsu2025,
  author = {Hsu, Enshuo and Roberts, Kirk},
  title = {LLM-IE: a python package for biomedical generative information extraction with large language models},
  journal = {JAMIA Open},
  year = {2025},
  volume = {8},
  number = {2},
  doi = {10.1093/jamiaopen/ooaf012}
}
Kostenlos starten →