EUVIMEDOpdag EUVIMED
Open access

Ontology-Based Medication Named Entity Recognition Using Pretrained Transformer Models From a Thai Hospital: Model Fine-Tuning and Validation Study

Natthanaphop Isaradech iD, Wachiranun Sirikul iD, Stefan Schulz iD, Markus Kreuzthaler iD

JMIR Formative Research · 2026-03-20 · 10 · e82685-e82685

DOI: 10.2196/82685 ↗

At a glance

Journal article in JMIR Formative Research, published online on 2026-03-20. Written by Natthanaphop Isaradech and 3 co-authors. Institution: Environmental and Occupational Medicine Excellence Center, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand. Major MEDLINE topics: Electronic Health Records, Natural Language Processing, Pharmaceutical Preparations. 55 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Extracting accurate medication information from Thai hospital records presents challenges due to the narrative style of medical notes, which often combine Thai and English terminology. Named entity recognition (NER) serves as the foundational step for advanced clinical information extraction (IE) tasks, including medical concept normalization and relation extraction. This study aimed to establish a robust NER framework to address these difficulties by leveraging ontology-based annotation and pretrained transformer models.

Objective

The primary objective of this study was to evaluate the performance of 5 fine-tuned pretrained transformer models—BioClinicalBERT, ClinicalBERT, PubMedBERT, MultilingualBERT, and ThaiBERT—based on Bidirectional Encoder Representations from Transformers (BERT) in extracting structured medication information from unstructured Thai hospital discharge summaries.

Methods

Ninety discharge summaries were collected from Maharaj Nakhon Chiang Mai Hospital. These documents were annotated by physicians following the annotation guidelines based on international standards, including Systematized Nomenclature of Medicine-Clinical Terms (SNOMED-CT) and Health Level Seven Fast Healthcare Interoperability Resources (HL7 FHIR). The dataset was divided into fine-tuning (70 records, 78%, 2030 annotated spans), validation (10 records, 11%, 277 annotated spans), and testing sets (10 records, 11%, 358 annotated spans). The 5 transformer models were fine-tuned and evaluated using this annotated data to recognize and classify key medication entities (substance, route of administration, unit of measure, time patterns, and unit of presentation).

Results

We found that all models had good NER performance metrics in both the validation and test datasets. Regarding test performance, ClinicalBERT achieved the highest exact F 1 -score at 0.973, compared with 0.968 for BioClinicalBERT, 0.925 for PubMedBERT, 0.931 for MultilingualBERT, and 0.969 for ThaiBERT. All models showed strength in accurately identifying “Substance” and “Dosage” entities, whereas “Unit of Measure” proved to be the most challenging entity type due to implicit information in the source text for all models.

Conclusions

The findings suggest that ontology-based medication IE using transformer-based models holds promise for enhancing data standardization and interoperability within the Thai health care system. Future work will need to leverage the granular annotations preserved in the dataset to develop medical concept normalization and relation extraction models to complete the medical IE system.

Subjects

MeSH terms (MEDLINE)

Electronic Health RecordsNatural Language ProcessingPharmaceutical PreparationsHospitalsThailandPatient Discharge

Author keywords

annotationsdeep learningelectronic medical prescriptionsinformation extractionknowledge representationnamed entity recognitionnatural language processingontology

Substances

Pharmaceutical Preparations

Authors and institutions

  • Environmental and Occupational Medicine Excellence Center, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand.
  • Department of Community Medicine, Faculty of Medicine, Chiang Mai University, Inthawarorot Road, Si Phum, Mueang, Chiang Mai, 50200, Thailand, 66 53935472.
  • Department of Biomedical Informatics and Clinical Epidemiology, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand.
  • Center of Data Analytics and Knowledge Synthesis for Health Care, Chiang Mai University, Chiang Mai, Thailand.
  • Institute for Medical Informatics, Statistics and Documentation, Medical University of Graz, Graz, Austria.

ORCID profiles: Natthanaphop Isaradech, Wachiranun Sirikul, Stefan Schulz, Markus Kreuzthaler

Cite

APA

Isaradech, N., Sirikul, W., Schulz, S., & Kreuzthaler, M. (2026). Ontology-Based Medication Named Entity Recognition Using Pretrained Transformer Models From a Thai Hospital: Model Fine-Tuning and Validation Study. JMIR Formative Research, 10, e82685-e82685. https://doi.org/10.2196/82685

Vancouver

Isaradech N, Sirikul W, Schulz S, Kreuzthaler M. Ontology-Based Medication Named Entity Recognition Using Pretrained Transformer Models From a Thai Hospital: Model Fine-Tuning and Validation Study. JMIR Formative Research. 2026;10:e82685-e82685. doi:10.2196/82685

BibTeX
@article{Isaradech2026,
  author = {Isaradech, Natthanaphop and Sirikul, Wachiranun and Schulz, Stefan and Kreuzthaler, Markus},
  title = {Ontology-Based Medication Named Entity Recognition Using Pretrained Transformer Models From a Thai Hospital: Model Fine-Tuning and Validation Study},
  journal = {JMIR Formative Research},
  year = {2026},
  volume = {10},
  pages = {e82685--e82685},
  doi = {10.2196/82685}
}
Start for free →