German Medical NER with BERT and LLMs: The Impact of Training Data Size
Studies in Health Technology and Informatics · 2025
DOI: 10.3233/shti250469 ↗Kurz gefasst
Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, 2025. Verfasst von Suteera Seeha und 7 weiteren Autor:innen. Beteiligte Einrichtung: Institute of AI and Informatics in Medicine (AIIM), TUM University Hospital, Technical University of Munich, Munich, Germany. Hauptthemen laut MEDLINE: Natural Language Processing, Vocabulary, Controlled, Terminology as Topic. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Named Entity Recognition (NER) in the medical domain often presents significant challenges due to the complexity and specificity of medical terminology, especially in lower-resource settings where annotated data is scarce. This study explores the performance of an exemplary large language model and a BERT-based model in the context of NER for German medical texts. We focus on the impact of different data sizes for training and their performance to simulate lower-resource conditions. Both models are evaluated on two German annotated corpora. Our results reveal that both models perform rather similar on both datasets, with LLaMA3.1 performing slightly better with less training material.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of AI and Informatics in Medicine (AIIM), TUM University Hospital, Technical University of Munich, Munich, Germany.
Zitieren
APA
Seeha, S., Wu, S., Hofenbitzer, J., Benzoni, C., Pallaoro, P., Scheible, R., Boeker, M., & Modersohn, L. (2025). German Medical NER with BERT and LLMs: The Impact of Training Data Size. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti250469
Vancouver
Seeha S, Wu S, Hofenbitzer J, Benzoni C, Pallaoro P, Scheible R, et al. German Medical NER with BERT and LLMs: The Impact of Training Data Size. Studies in Health Technology and Informatics. 2025. doi:10.3233/shti250469
BibTeX
@article{Seeha2025,
author = {Seeha, Suteera and Wu, Sihan and Hofenbitzer, Justin and Benzoni, Claudio and Pallaoro, Peter and Scheible, Raphael and Boeker, Martin and Modersohn, Luise},
title = {German Medical NER with BERT and LLMs: The Impact of Training Data Size},
journal = {Studies in Health Technology and Informatics},
year = {2025},
doi = {10.3233/shti250469}
}
EUVIMED