LLM-IE: a python package for biomedical generative information extraction with large language models
JAMIA Open · 06.03.2025 · 8 (2)
DOI: 10.1093/jamiaopen/ooaf012 ↗Kurz gefasst
Fachartikel in der Zeitschrift JAMIA Open, online erschienen am 12.03.2025. Verfasst von Enshuo Hsu und 1 weiteren Autor:innen. Beteiligte Einrichtung: McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX 77030, United States. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NLM NIH HHS, National Library of Medicine.
Abstract (Originalsprache)
Objectives
Despite the recent adoption of large language models (LLMs) for biomedical information extraction (IE), challenges in prompt engineering and algorithms persist, with no dedicated software available. To address this, we developed LLM-IE: a Python package for building complete IE pipelines. Materials and Methods The LLM-IE supports named entity recognition, entity attribute extraction, and relation extraction tasks. We benchmarked it on the i2b2 clinical datasets.
Results
The sentence-based prompting algorithm resulted in the best 8-shot performance of over 70% strict F1 for entity extraction and about 60% F1 for entity attribute extraction.
Discussion
We developed a Python package, LLM-IE, highlighting (1) an interactive LLM agent to support schema definition and prompt design, (2) state-of-the-art prompting algorithms, and (3) visualization features.
Conclusion
The LLM-IE provides essential building blocks for developing robust information extraction pipelines. Future work will aim to expand its features and further optimize computational efficiency.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- McWilliams School of Biomedical Informatics, University of Texas Health Science Center at Houston, Houston, TX 77030, United States.
- Enterprise Development and Integration, University of Texas MD Anderson Cancer Center, Houston, TX 77030, United States.
ORCID-Profile: Enshuo Hsu
Förderung
- NLM NIH HHS
- National Library of Medicine
Zitieren
APA
Hsu, E., & Roberts, K. (2025). LLM-IE: a python package for biomedical generative information extraction with large language models. JAMIA Open, 8(2). https://doi.org/10.1093/jamiaopen/ooaf012
Vancouver
Hsu E, Roberts K. LLM-IE: a python package for biomedical generative information extraction with large language models. JAMIA Open. 2025;8(2). doi:10.1093/jamiaopen/ooaf012
BibTeX
@article{Hsu2025,
author = {Hsu, Enshuo and Roberts, Kirk},
title = {LLM-IE: a python package for biomedical generative information extraction with large language models},
journal = {JAMIA Open},
year = {2025},
volume = {8},
number = {2},
doi = {10.1093/jamiaopen/ooaf012}
}
EUVIMED