EUVIMEDEUVIMED entdecken
Open Access

Ontology-Based Medication Named Entity Recognition Using Pretrained Transformer Models From a Thai Hospital: Model Fine-Tuning and Validation Study

Natthanaphop Isaradech iD, Wachiranun Sirikul iD, Stefan Schulz iD, Markus Kreuzthaler iD

JMIR Formative Research · 20.03.2026 · 10 · e82685-e82685

DOI: 10.2196/82685 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JMIR Formative Research, online erschienen am 20.03.2026. Verfasst von Natthanaphop Isaradech und 3 weiteren Autor:innen. Beteiligte Einrichtung: Environmental and Occupational Medicine Excellence Center, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand. Hauptthemen laut MEDLINE: Electronic Health Records, Natural Language Processing, Pharmaceutical Preparations. Die Arbeit nennt 55 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Extracting accurate medication information from Thai hospital records presents challenges due to the narrative style of medical notes, which often combine Thai and English terminology. Named entity recognition (NER) serves as the foundational step for advanced clinical information extraction (IE) tasks, including medical concept normalization and relation extraction. This study aimed to establish a robust NER framework to address these difficulties by leveraging ontology-based annotation and pretrained transformer models.

Objective

The primary objective of this study was to evaluate the performance of 5 fine-tuned pretrained transformer models—BioClinicalBERT, ClinicalBERT, PubMedBERT, MultilingualBERT, and ThaiBERT—based on Bidirectional Encoder Representations from Transformers (BERT) in extracting structured medication information from unstructured Thai hospital discharge summaries.

Methods

Ninety discharge summaries were collected from Maharaj Nakhon Chiang Mai Hospital. These documents were annotated by physicians following the annotation guidelines based on international standards, including Systematized Nomenclature of Medicine-Clinical Terms (SNOMED-CT) and Health Level Seven Fast Healthcare Interoperability Resources (HL7 FHIR). The dataset was divided into fine-tuning (70 records, 78%, 2030 annotated spans), validation (10 records, 11%, 277 annotated spans), and testing sets (10 records, 11%, 358 annotated spans). The 5 transformer models were fine-tuned and evaluated using this annotated data to recognize and classify key medication entities (substance, route of administration, unit of measure, time patterns, and unit of presentation).

Results

We found that all models had good NER performance metrics in both the validation and test datasets. Regarding test performance, ClinicalBERT achieved the highest exact F 1 -score at 0.973, compared with 0.968 for BioClinicalBERT, 0.925 for PubMedBERT, 0.931 for MultilingualBERT, and 0.969 for ThaiBERT. All models showed strength in accurately identifying “Substance” and “Dosage” entities, whereas “Unit of Measure” proved to be the most challenging entity type due to implicit information in the source text for all models.

Conclusions

The findings suggest that ontology-based medication IE using transformer-based models holds promise for enhancing data standardization and interoperability within the Thai health care system. Future work will need to leverage the granular annotations preserved in the dataset to develop medical concept normalization and relation extraction models to complete the medical IE system.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Electronic Health RecordsNatural Language ProcessingPharmaceutical PreparationsHospitalsThailandPatient Discharge

Stichwörter der Autor:innen

annotationsdeep learningelectronic medical prescriptionsinformation extractionknowledge representationnamed entity recognitionnatural language processingontology

Substanzen

Pharmaceutical Preparations

Autor:innen und Institutionen

  • Environmental and Occupational Medicine Excellence Center, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand.
  • Department of Community Medicine, Faculty of Medicine, Chiang Mai University, Inthawarorot Road, Si Phum, Mueang, Chiang Mai, 50200, Thailand, 66 53935472.
  • Department of Biomedical Informatics and Clinical Epidemiology, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand.
  • Center of Data Analytics and Knowledge Synthesis for Health Care, Chiang Mai University, Chiang Mai, Thailand.
  • Institute for Medical Informatics, Statistics and Documentation, Medical University of Graz, Graz, Austria.

ORCID-Profile: Natthanaphop Isaradech, Wachiranun Sirikul, Stefan Schulz, Markus Kreuzthaler

Zitieren

APA

Isaradech, N., Sirikul, W., Schulz, S., & Kreuzthaler, M. (2026). Ontology-Based Medication Named Entity Recognition Using Pretrained Transformer Models From a Thai Hospital: Model Fine-Tuning and Validation Study. JMIR Formative Research, 10, e82685-e82685. https://doi.org/10.2196/82685

Vancouver

Isaradech N, Sirikul W, Schulz S, Kreuzthaler M. Ontology-Based Medication Named Entity Recognition Using Pretrained Transformer Models From a Thai Hospital: Model Fine-Tuning and Validation Study. JMIR Formative Research. 2026;10:e82685-e82685. doi:10.2196/82685

BibTeX
@article{Isaradech2026,
  author = {Isaradech, Natthanaphop and Sirikul, Wachiranun and Schulz, Stefan and Kreuzthaler, Markus},
  title = {Ontology-Based Medication Named Entity Recognition Using Pretrained Transformer Models From a Thai Hospital: Model Fine-Tuning and Validation Study},
  journal = {JMIR Formative Research},
  year = {2026},
  volume = {10},
  pages = {e82685--e82685},
  doi = {10.2196/82685}
}
Kostenlos starten →