What Kind of Transformer Models to Use for the ICD-10 Codes Classification Task
Studies in Health Technology and Informatics · 2024
DOI: 10.3233/shti240580 ↗Kurz gefasst
Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, 2024. Verfasst von Mariem Mansour und 3 weiteren Autor:innen. Beteiligte Einrichtung: Bern University of Applied Sciences, Switzerland. Hauptthemen laut MEDLINE: International Classification of Diseases, Natural Language Processing, Electronic Health Records. Die Arbeit wurde bisher 2-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Coding according to the International Classification of Diseases (ICD)-10 and its clinical modifications (CM) is inherently complex and expensive. Natural Language Processing (NLP) assists by simplifying the analysis of unstructured data from electronic health records, thereby facilitating diagnosis coding. This study investigates the suitability of transformer models for ICD-10 classification, considering both encoder and encoder-decoder architectures. The analysis is performed on clinical discharge summaries from the Medical Information Mart for Intensive Care (MIMIC)-IV dataset, which contains an extensive collection of electronic health records. Pre-trained models such as BioBERT, ClinicalBERT, ClinicalLongformer, and ClinicalBigBird are adapted for the coding task, incorporating specific preprocessing techniques to enhance performance. The findings indicate that increasing context length improves accuracy, and that the difference in accuracy between encoder and encoder-decoder models is negligible.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Bern University of Applied Sciences, Switzerland.
Zitieren
APA
Mansour, M., Yilmaz, F., Miletic, M., & Sariyar, M. (2024). What Kind of Transformer Models to Use for the ICD-10 Codes Classification Task. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti240580
Vancouver
Mansour M, Yilmaz F, Miletic M, Sariyar M. What Kind of Transformer Models to Use for the ICD-10 Codes Classification Task. Studies in Health Technology and Informatics. 2024. doi:10.3233/shti240580
BibTeX
@article{Mansour2024,
author = {Mansour, Mariem and Yilmaz, Fatma and Miletic, Marko and Sariyar, Murat},
title = {What Kind of Transformer Models to Use for the ICD-10 Codes Classification Task},
journal = {Studies in Health Technology and Informatics},
year = {2024},
doi = {10.3233/shti240580}
}
EUVIMED