EUVIMEDOpdag EUVIMED
Randomisierte kontrollierte StudieOpen access

Artificial Intelligence to Improve Clinical Coding Practice in Scandinavia: Crossover Randomized Controlled Trial

Taridzo Chomutare, Therese Olsen Svenning, Miguel Ángel Tejedor Hernández, Phuong Dinh Ngo, Andrius Budrionis, Kaisa Markljung, Lill Irene Hind, Torbjørn Torsvik, Karl Øyvind Mikalsen, Aleksandar Babic, Hercules Dalianis

Journal of Medical Internet Research · 2025

DOI: 10.2196/71904 ↗

At a glance

Randomisierte kontrollierte Studie in Journal of Medical Internet Research, 2025. Written by Taridzo Chomutare and 10 co-authors. Institution: Department of Computer Science, Faculty of Science and Technology, UiT The Arctic University of Norway, Hansine Hansens vei 54, Tromsø, N-9037, Norwa…. Major MEDLINE topics: Artificial Intelligence, Clinical Coding. Cited 16 times so far (Crossref); 32 references. The full text is freely available in PubMed Central.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

Background

Clinical coding is critical for hospital reimbursement, quality assessment, and health care planning. In Scandinavia, however, coding is often done by junior doctors or medical secretaries, leading to high rates of coding errors. Artificial intelligence (AI) tools, particularly semiautomatic computer-assisted coding tools, have the potential to reduce the excessive burden of administrative and clinical documentation. To date, much of what we know regarding these tools comes from lab-based evaluations, which often fail to account for real-world complexity and variability in clinical text.

Objective

This study aims to investigate whether an AI tool developed by by Norwegian Centre for E-health Research at the University Hospital of North Norway, Easy-ICD (International Classification of Diseases), can enhance clinical coding practices by reducing coding time and improving data quality in a realistic setting. We specifically examined whether improvements differ between long and short clinical notes, defined by word count.

Methods

An AI tool, Easy-ICD, was developed to assist clinical coders and was tested for improving both accuracy and time in a 1:1 crossover randomized controlled trial conducted in Sweden and Norway. Participants were randomly assigned to 2 groups (Sequence AB or BA), and crossed over between coding longer texts (Period 1; mean 307, SD 90; words) versus shorter texts (Period 2; mean 166, SD 55; words), while using our tool versus not using our tool. This was a purely web-based trial, where participants were recruited through email. Coding time and accuracy were logged and analyzed using Mann-Whitney U tests for each of the 2 periods independently, due to differing text lengths in each period.

Results

The trial had 17 participants enrolled, but only data from 15 participants (300 coded notes) were analyzed, excluding 2 incomplete records. Based on the Mann-Whitney U test, the median coding time difference for longer clinical text sequences was 123 seconds ( P

Subjects

MeSH terms (MEDLINE)

Artificial IntelligenceClinical CodingHumansCross-Over StudiesNorwayInternational Classification of DiseasesSweden

Author keywords

AICACComputer Assisted CodingEasy-ICDICD-10ICD-11International Statistical Classification of DiseasesInternational Statistical Classification of Diseases and Related Health Problem…artificial intelligenceclinical codinglarge language models

Authors and institutions

  • Department of Computer Science, Faculty of Science and Technology, UiT The Arctic University of Norway, Hansine Hansens vei 54, Tromsø, N-9037, Norway, 47 47680032.
  • Department of Health Data Analytics, Norwegian Centre for E-Health Research, Tromsø, Norway.
  • Department of Clinic for Surgery, Oncology and Women Health, University Hospital of North Norway, Tromsø, Norway.
  • Department of Physics and Technology, UiT The Arctic University of Norway, Tromsø, Norway.
  • Group Research and Development, DNV (Norway), Sandvika, Norway.
  • Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden.

Cite

APA

Chomutare, T., Svenning, T. O., Hernández, M. Á. T., Ngo, P. D., Budrionis, A., Markljung, K., Hind, L. I., Torsvik, T., Mikalsen, K. Ø., Babic, A., & Dalianis, H. (2025). Artificial Intelligence to Improve Clinical Coding Practice in Scandinavia: Crossover Randomized Controlled Trial. Journal of Medical Internet Research. https://doi.org/10.2196/71904

Vancouver

Chomutare T, Svenning TO, Hernández MÁT, Ngo PD, Budrionis A, Markljung K, et al. Artificial Intelligence to Improve Clinical Coding Practice in Scandinavia: Crossover Randomized Controlled Trial. Journal of Medical Internet Research. 2025. doi:10.2196/71904

BibTeX
@article{Chomutare2025,
  author = {Chomutare, Taridzo and Svenning, Therese Olsen and Hernández, Miguel Ángel Tejedor and Ngo, Phuong Dinh and Budrionis, Andrius and Markljung, Kaisa and Hind, Lill Irene and Torsvik, Torbjørn and Mikalsen, Karl Øyvind and Babic, Aleksandar and Dalianis, Hercules},
  title = {Artificial Intelligence to Improve Clinical Coding Practice in Scandinavia: Crossover Randomized Controlled Trial},
  journal = {Journal of Medical Internet Research},
  year = {2025},
  doi = {10.2196/71904}
}
Start for free →