Artificial Intelligence to Improve Clinical Coding Practice in Scandinavia: Crossover Randomized Controlled Trial
Journal of Medical Internet Research · 2025
DOI: 10.2196/71904 ↗At a glance
Randomisierte kontrollierte Studie in Journal of Medical Internet Research, 2025. Written by Taridzo Chomutare and 10 co-authors. Institution: Department of Computer Science, Faculty of Science and Technology, UiT The Arctic University of Norway, Hansine Hansens vei 54, Tromsø, N-9037, Norwa…. Major MEDLINE topics: Artificial Intelligence, Clinical Coding. Cited 16 times so far (Crossref); 32 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Clinical coding is critical for hospital reimbursement, quality assessment, and health care planning. In Scandinavia, however, coding is often done by junior doctors or medical secretaries, leading to high rates of coding errors. Artificial intelligence (AI) tools, particularly semiautomatic computer-assisted coding tools, have the potential to reduce the excessive burden of administrative and clinical documentation. To date, much of what we know regarding these tools comes from lab-based evaluations, which often fail to account for real-world complexity and variability in clinical text.
Objective
This study aims to investigate whether an AI tool developed by by Norwegian Centre for E-health Research at the University Hospital of North Norway, Easy-ICD (International Classification of Diseases), can enhance clinical coding practices by reducing coding time and improving data quality in a realistic setting. We specifically examined whether improvements differ between long and short clinical notes, defined by word count.
Methods
An AI tool, Easy-ICD, was developed to assist clinical coders and was tested for improving both accuracy and time in a 1:1 crossover randomized controlled trial conducted in Sweden and Norway. Participants were randomly assigned to 2 groups (Sequence AB or BA), and crossed over between coding longer texts (Period 1; mean 307, SD 90; words) versus shorter texts (Period 2; mean 166, SD 55; words), while using our tool versus not using our tool. This was a purely web-based trial, where participants were recruited through email. Coding time and accuracy were logged and analyzed using Mann-Whitney U tests for each of the 2 periods independently, due to differing text lengths in each period.
Results
The trial had 17 participants enrolled, but only data from 15 participants (300 coded notes) were analyzed, excluding 2 incomplete records. Based on the Mann-Whitney U test, the median coding time difference for longer clinical text sequences was 123 seconds ( P
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Computer Science, Faculty of Science and Technology, UiT The Arctic University of Norway, Hansine Hansens vei 54, Tromsø, N-9037, Norway, 47 47680032.
- Department of Health Data Analytics, Norwegian Centre for E-Health Research, Tromsø, Norway.
- Department of Clinic for Surgery, Oncology and Women Health, University Hospital of North Norway, Tromsø, Norway.
- Department of Physics and Technology, UiT The Arctic University of Norway, Tromsø, Norway.
- Group Research and Development, DNV (Norway), Sandvika, Norway.
- Department of Computer and Systems Sciences, Stockholm University, Stockholm, Sweden.
Cite
APA
Chomutare, T., Svenning, T. O., Hernández, M. Á. T., Ngo, P. D., Budrionis, A., Markljung, K., Hind, L. I., Torsvik, T., Mikalsen, K. Ø., Babic, A., & Dalianis, H. (2025). Artificial Intelligence to Improve Clinical Coding Practice in Scandinavia: Crossover Randomized Controlled Trial. Journal of Medical Internet Research. https://doi.org/10.2196/71904
Vancouver
Chomutare T, Svenning TO, Hernández MÁT, Ngo PD, Budrionis A, Markljung K, et al. Artificial Intelligence to Improve Clinical Coding Practice in Scandinavia: Crossover Randomized Controlled Trial. Journal of Medical Internet Research. 2025. doi:10.2196/71904
BibTeX
@article{Chomutare2025,
author = {Chomutare, Taridzo and Svenning, Therese Olsen and Hernández, Miguel Ángel Tejedor and Ngo, Phuong Dinh and Budrionis, Andrius and Markljung, Kaisa and Hind, Lill Irene and Torsvik, Torbjørn and Mikalsen, Karl Øyvind and Babic, Aleksandar and Dalianis, Hercules},
title = {Artificial Intelligence to Improve Clinical Coding Practice in Scandinavia: Crossover Randomized Controlled Trial},
journal = {Journal of Medical Internet Research},
year = {2025},
doi = {10.2196/71904}
}
EUVIMED