EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

What Kind of Transformer Models to Use for the ICD-10 Codes Classification Task

Mariem Mansour, Fatma Yilmaz, Marko Miletic, Murat Sariyar

Studies in Health Technology and Informatics · 2024

DOI: 10.3233/shti240580 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, 2024. Verfasst von Mariem Mansour und 3 weiteren Autor:innen. Beteiligte Einrichtung: Bern University of Applied Sciences, Switzerland. Hauptthemen laut MEDLINE: International Classification of Diseases, Natural Language Processing, Electronic Health Records. Die Arbeit wurde bisher 2-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Coding according to the International Classification of Diseases (ICD)-10 and its clinical modifications (CM) is inherently complex and expensive. Natural Language Processing (NLP) assists by simplifying the analysis of unstructured data from electronic health records, thereby facilitating diagnosis coding. This study investigates the suitability of transformer models for ICD-10 classification, considering both encoder and encoder-decoder architectures. The analysis is performed on clinical discharge summaries from the Medical Information Mart for Intensive Care (MIMIC)-IV dataset, which contains an extensive collection of electronic health records. Pre-trained models such as BioBERT, ClinicalBERT, ClinicalLongformer, and ClinicalBigBird are adapted for the coding task, incorporating specific preprocessing techniques to enhance performance. The findings indicate that increasing context length improves accuracy, and that the difference in accuracy between encoder and encoder-decoder models is negligible.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

International Classification of DiseasesNatural Language ProcessingElectronic Health RecordsHumansClinical Coding

Stichwörter der Autor:innen

BERTClinicalBigBirdClinicalLongformerNLPtransformer models

Autor:innen und Institutionen

  • Bern University of Applied Sciences, Switzerland.

Zitieren

APA

Mansour, M., Yilmaz, F., Miletic, M., & Sariyar, M. (2024). What Kind of Transformer Models to Use for the ICD-10 Codes Classification Task. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti240580

Vancouver

Mansour M, Yilmaz F, Miletic M, Sariyar M. What Kind of Transformer Models to Use for the ICD-10 Codes Classification Task. Studies in Health Technology and Informatics. 2024. doi:10.3233/shti240580

BibTeX
@article{Mansour2024,
  author = {Mansour, Mariem and Yilmaz, Fatma and Miletic, Marko and Sariyar, Murat},
  title = {What Kind of Transformer Models to Use for the ICD-10 Codes Classification Task},
  journal = {Studies in Health Technology and Informatics},
  year = {2024},
  doi = {10.3233/shti240580}
}
Kostenlos starten →