EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

German Medical NER with BERT and LLMs: The Impact of Training Data Size

Suteera Seeha, Sihan Wu, Justin Hofenbitzer, Claudio Benzoni, Peter Pallaoro, Raphael Scheible, Martin Boeker, Luise Modersohn

Studies in Health Technology and Informatics · 2025

DOI: 10.3233/shti250469 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, 2025. Verfasst von Suteera Seeha und 7 weiteren Autor:innen. Beteiligte Einrichtung: Institute of AI and Informatics in Medicine (AIIM), TUM University Hospital, Technical University of Munich, Munich, Germany. Hauptthemen laut MEDLINE: Natural Language Processing, Vocabulary, Controlled, Terminology as Topic. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Named Entity Recognition (NER) in the medical domain often presents significant challenges due to the complexity and specificity of medical terminology, especially in lower-resource settings where annotated data is scarce. This study explores the performance of an exemplary large language model and a BERT-based model in the context of NER for German medical texts. We focus on the impact of different data sizes for training and their performance to simulate lower-resource conditions. Both models are evaluated on two German annotated corpora. Our results reveal that both models perform rather similar on both datasets, with LLaMA3.1 performing slightly better with less training material.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Natural Language ProcessingVocabulary, ControlledTerminology as TopicGermanyHumans

Stichwörter der Autor:innen

Artificial IntelligenceBERTLLaMALarge Language modelNamed Entity RecognitionNatural Language Processing

Autor:innen und Institutionen

  • Institute of AI and Informatics in Medicine (AIIM), TUM University Hospital, Technical University of Munich, Munich, Germany.

Zitieren

APA

Seeha, S., Wu, S., Hofenbitzer, J., Benzoni, C., Pallaoro, P., Scheible, R., Boeker, M., & Modersohn, L. (2025). German Medical NER with BERT and LLMs: The Impact of Training Data Size. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti250469

Vancouver

Seeha S, Wu S, Hofenbitzer J, Benzoni C, Pallaoro P, Scheible R, et al. German Medical NER with BERT and LLMs: The Impact of Training Data Size. Studies in Health Technology and Informatics. 2025. doi:10.3233/shti250469

BibTeX
@article{Seeha2025,
  author = {Seeha, Suteera and Wu, Sihan and Hofenbitzer, Justin and Benzoni, Claudio and Pallaoro, Peter and Scheible, Raphael and Boeker, Martin and Modersohn, Luise},
  title = {German Medical NER with BERT and LLMs: The Impact of Training Data Size},
  journal = {Studies in Health Technology and Informatics},
  year = {2025},
  doi = {10.3233/shti250469}
}
Kostenlos starten →