Development and Validation of Human-AI Collaborative Workflow in SNOMED CT Mapping of Bilingual Clinical Text
Journal of Medical Systems · 2026
DOI: 10.1007/s10916-026-02465-3 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Medical Systems, 2026. Verfasst von Hyeonhoon Lee und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, Republic of Korea. Hauptthemen laut MEDLINE: Systematized Nomenclature of Medicine, Workflow, Artificial Intelligence, Multilingualism. Die Arbeit nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Korea Health Industry Development Institute.
Abstract (Originalsprache)
Systematized Nomenclature of Medicine–Clinical Terminology (SNOMED CT) is the principal international standard for semantic interoperability of clinical information, but mapping free-text clinical narratives to SNOMED CT concepts remains labor-intensive. We developed a large language model agent system for mapping bilingual clinical text to SNOMED CT concepts and evaluated its effect on mapping accuracy and efficiency within a human-AI collaborative workflow. We designed a three-module agent system comprising translation, abbreviation expansion, and vector-based retrieval components, integrated with a pre-embedded SNOMED CT vector database. Three health information managers independently mapped bilingual clinical text segments using three approaches: human-only, Agent-only, and Agent-assisted human mapping. Performance was evaluated by using hit rate, precision, recall, and F1 score at k = 1 and 5, and R-precision. Mapping time was compared between human-only and human-AI collaborative approaches. A total of 2,261 de-identified clinical text segments across nine clinical categories were collected at a tertiary academic hospital in South Korea. The human-AI collaborative workflow, which expanded the set of valid SNOMED CT candidates presented at each mapping decision, raised pooled hit rate@1 from 0.837 to 0.868 (difference 0.031, 95% confidence interval [CI] 0.021 to 0.042; p < 0.001), raised R-precision from 0.632 to 0.674 (difference 0.042, 95% CI 0.034 to 0.051; p < 0.001), and reduced total mapping time by 53.9% (from 1.57 to 0.72 min per segment, including agent processing). By expanding the space of valid SNOMED CT candidates available to expert mappers, the human-AI collaborative approach improved SNOMED CT mapping accuracy while reducing time by about half. Its modular architecture, supporting periodic vector database updates without retraining, offers a sustainable and efficient solution for bilingual clinical terminology standardization.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, Republic of Korea.
- Healthcare AI Research Institute, Seoul National University Hospital, Seoul, South Korea.
- Department of Medicine, Seoul National University College of Medicine, Seoul, South Korea.
- Office of Hospital Information, Seoul National University Hospital, Seoul, South Korea.
- Department of Interdisciplinary Program in Medical Informatics, Seoul National University, Seoul, Republic of Korea.
- Healthcare AI Research Institute, Seoul National University Hospital, Seoul, South Korea. vital@snu.ac.kr.
Förderung
- Korea Health Industry Development Institute
Zitieren
APA
Lee, H., Choi, S., Kim, D., Hong, K., Kim, H., Jeong, C. W., & Lee, H. C. (2026). Development and Validation of Human-AI Collaborative Workflow in SNOMED CT Mapping of Bilingual Clinical Text. Journal of Medical Systems. https://doi.org/10.1007/s10916-026-02465-3
Vancouver
Lee H, Choi S, Kim D, Hong K, Kim H, Jeong CW, et al. Development and Validation of Human-AI Collaborative Workflow in SNOMED CT Mapping of Bilingual Clinical Text. Journal of Medical Systems. 2026. doi:10.1007/s10916-026-02465-3
BibTeX
@article{Lee2026,
author = {Lee, Hyeonhoon and Choi, Seonhye and Kim, Duyeon and Hong, Kyunglan and Kim, Hyeonsik and Jeong, Chang Wook and Lee, Hyung-Chul},
title = {Development and Validation of Human-AI Collaborative Workflow in SNOMED CT Mapping of Bilingual Clinical Text},
journal = {Journal of Medical Systems},
year = {2026},
doi = {10.1007/s10916-026-02465-3}
}
EUVIMED