EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A framework for structuring Thai medical documents using systematized nomenclature of medicine clinical terms and large language models

Nat Tangchitnob iD, Wanchana Ponthongmak iD, Boonchai Kijsanayotin, Oraluck Pattanaprateep, Sithakom Phusanti, Pongsakorn Atiksawedparit, Kamonporn Suwanthaweemeesuk, Gareth J McKay, Takehiko Oami, Ammarin Thakkinstian

PLOS Digital Health · 30.10.2026 · 5 (10) · e0001791

DOI: 10.1371/journal.pdig.0001791 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Digital Health, online erschienen am 30.10.2026. Verfasst von Nat Tangchitnob und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Clinical Epidemiology and Biostatistics, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Council of Thailand.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Systematized Nomenclature of Medicine – Clinical Terms (SNOMED CT) enables semantically interoperable health data, but implementation in Thailand is hindered by language and workflow challenges. We evaluated whether large language models (LLMs) can automate SNOMED CT concept extraction from Thai clinical documents. The objectives of this study are to develop a proof-of-concept framework for automated clinical named entity recognition and SNOMED CT concept linking from Thai medical documents, and to compare the performance and resource requirements of closed-source and open-source LLMs on a human-annotated dataset. The dataset was manually annotated from 220 Thai medical documents (6,390 entities) from three outpatient departments. Our retrieval-augmented framework was evaluated using four LLMs (Gemini 2.5 Pro, GPT-4.1, Qwen 3, and MedGemma) as experimental based models which were comparatively analyzed for entity recognition using precision, recall, F1 score and concept linking using character-level metric, Intersection over Union (IoU), as well as resource consumptions. For entity recognition, Gemini achieved the highest performance (loose F1 83.31%). For SNOMED CT concept extraction ranked most similar (Top-1) by encoder models for retrieval and re-ranking, IoU scores were 39.42% (Gemini), 34.44% (GPT), 29.86% (MedGemma), and 28.62% (Qwen). Average processing time for end-to-end extraction was 5–6 minutes per document for Gemini and GPT, with cost estimates in United states dollars (USD) of USD 0.035 and USD 0.019 per document, respectively; local open-source inference required up to 10 minutes per document. This study established a proof-of-concept framework for automated clinical entity recognition and SNOMED CT concept linking from Thai medical documents, demonstrating practical LLM performance with trade-offs between accuracy, cost, and efficiency across closed-source and open-source models.

Autor:innen und Institutionen

  • Department of Clinical Epidemiology and Biostatistics, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand.
  • Thai Health Information Standards Development Center, Health Systems Research Institute, Ministry of Public Health, Bangkok, Thailand.
  • Faculty of Medicine Ramathibodi Hospital, Chakri Naruebodindra Medical Institute, Mahidol University, Bangkok, Thailand.
  • Centre for Public Health, Queen's University Belfast, Belfast, United Kingdom.
  • Department of Emergency and Critical Care Medicine, Chiba University Graduate School of Medicine, Chiba, Japan.

ORCID-Profile: Nat Tangchitnob, Wanchana Ponthongmak

Förderung

  • National Research Council of Thailand

Zitieren

APA

Tangchitnob, N., Ponthongmak, W., Kijsanayotin, B., Pattanaprateep, O., Phusanti, S., Atiksawedparit, P., Suwanthaweemeesuk, K., McKay, G. J., Oami, T., & Thakkinstian, A. (2026). A framework for structuring Thai medical documents using systematized nomenclature of medicine clinical terms and large language models. PLOS Digital Health, 5(10), e0001791. https://doi.org/10.1371/journal.pdig.0001791

Vancouver

Tangchitnob N, Ponthongmak W, Kijsanayotin B, Pattanaprateep O, Phusanti S, Atiksawedparit P, et al. A framework for structuring Thai medical documents using systematized nomenclature of medicine clinical terms and large language models. PLOS Digital Health. 2026;5(10):e0001791. doi:10.1371/journal.pdig.0001791

BibTeX
@article{Tangchitnob2026,
  author = {Tangchitnob, Nat and Ponthongmak, Wanchana and Kijsanayotin, Boonchai and Pattanaprateep, Oraluck and Phusanti, Sithakom and Atiksawedparit, Pongsakorn and Suwanthaweemeesuk, Kamonporn and McKay, Gareth J and Oami, Takehiko and Thakkinstian, Ammarin},
  title = {A framework for structuring Thai medical documents using systematized nomenclature of medicine clinical terms and large language models},
  journal = {PLOS Digital Health},
  year = {2026},
  volume = {5},
  number = {10},
  pages = {e0001791},
  doi = {10.1371/journal.pdig.0001791}
}
Kostenlos starten →