A framework for structuring Thai medical documents using systematized nomenclature of medicine clinical terms and large language models
PLOS Digital Health · 30.10.2026 · 5 (10) · e0001791
DOI: 10.1371/journal.pdig.0001791 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Digital Health, online erschienen am 30.10.2026. Verfasst von Nat Tangchitnob und 9 weiteren Autor:innen. Beteiligte Einrichtung: Department of Clinical Epidemiology and Biostatistics, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Council of Thailand.
Abstract (Originalsprache)
Systematized Nomenclature of Medicine – Clinical Terms (SNOMED CT) enables semantically interoperable health data, but implementation in Thailand is hindered by language and workflow challenges. We evaluated whether large language models (LLMs) can automate SNOMED CT concept extraction from Thai clinical documents. The objectives of this study are to develop a proof-of-concept framework for automated clinical named entity recognition and SNOMED CT concept linking from Thai medical documents, and to compare the performance and resource requirements of closed-source and open-source LLMs on a human-annotated dataset. The dataset was manually annotated from 220 Thai medical documents (6,390 entities) from three outpatient departments. Our retrieval-augmented framework was evaluated using four LLMs (Gemini 2.5 Pro, GPT-4.1, Qwen 3, and MedGemma) as experimental based models which were comparatively analyzed for entity recognition using precision, recall, F1 score and concept linking using character-level metric, Intersection over Union (IoU), as well as resource consumptions. For entity recognition, Gemini achieved the highest performance (loose F1 83.31%). For SNOMED CT concept extraction ranked most similar (Top-1) by encoder models for retrieval and re-ranking, IoU scores were 39.42% (Gemini), 34.44% (GPT), 29.86% (MedGemma), and 28.62% (Qwen). Average processing time for end-to-end extraction was 5–6 minutes per document for Gemini and GPT, with cost estimates in United states dollars (USD) of USD 0.035 and USD 0.019 per document, respectively; local open-source inference required up to 10 minutes per document. This study established a proof-of-concept framework for automated clinical entity recognition and SNOMED CT concept linking from Thai medical documents, demonstrating practical LLM performance with trade-offs between accuracy, cost, and efficiency across closed-source and open-source models.
Autor:innen und Institutionen
- Department of Clinical Epidemiology and Biostatistics, Faculty of Medicine Ramathibodi Hospital, Mahidol University, Bangkok, Thailand.
- Thai Health Information Standards Development Center, Health Systems Research Institute, Ministry of Public Health, Bangkok, Thailand.
- Faculty of Medicine Ramathibodi Hospital, Chakri Naruebodindra Medical Institute, Mahidol University, Bangkok, Thailand.
- Centre for Public Health, Queen's University Belfast, Belfast, United Kingdom.
- Department of Emergency and Critical Care Medicine, Chiba University Graduate School of Medicine, Chiba, Japan.
ORCID-Profile: Nat Tangchitnob, Wanchana Ponthongmak
Förderung
- National Research Council of Thailand
Zitieren
APA
Tangchitnob, N., Ponthongmak, W., Kijsanayotin, B., Pattanaprateep, O., Phusanti, S., Atiksawedparit, P., Suwanthaweemeesuk, K., McKay, G. J., Oami, T., & Thakkinstian, A. (2026). A framework for structuring Thai medical documents using systematized nomenclature of medicine clinical terms and large language models. PLOS Digital Health, 5(10), e0001791. https://doi.org/10.1371/journal.pdig.0001791
Vancouver
Tangchitnob N, Ponthongmak W, Kijsanayotin B, Pattanaprateep O, Phusanti S, Atiksawedparit P, et al. A framework for structuring Thai medical documents using systematized nomenclature of medicine clinical terms and large language models. PLOS Digital Health. 2026;5(10):e0001791. doi:10.1371/journal.pdig.0001791
BibTeX
@article{Tangchitnob2026,
author = {Tangchitnob, Nat and Ponthongmak, Wanchana and Kijsanayotin, Boonchai and Pattanaprateep, Oraluck and Phusanti, Sithakom and Atiksawedparit, Pongsakorn and Suwanthaweemeesuk, Kamonporn and McKay, Gareth J and Oami, Takehiko and Thakkinstian, Ammarin},
title = {A framework for structuring Thai medical documents using systematized nomenclature of medicine clinical terms and large language models},
journal = {PLOS Digital Health},
year = {2026},
volume = {5},
number = {10},
pages = {e0001791},
doi = {10.1371/journal.pdig.0001791}
}
EUVIMED