EUVIMEDEUVIMED entdecken
Crossref

Artificial versus Human Intelligence: Evaluating CPT Coding Accuracy in Extremity Microsurgical Reconstruction

Jonathan Childs, Juan E. Berner Gomez, Manuel R. Ortiz Llorens, Oriana Haran

Journal of Reconstructive Microsurgery Open · 01.07.2026 · 11 (02) · e31-e33

DOI: 10.1055/a-2920-4203 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Reconstructive Microsurgery Open, erschienen am 01.07.2026. Verfasst von Jonathan Childs und 3 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Current Procedural Terminology (CPT) coding in microsurgical reconstruction requires precise translation of complex procedures into billable codes. Manual coding requires training and experience and it is a time-consuming task, in which mistakes are possible. Artificial intelligence (AI) tools may offer an efficient alternative, but their accuracy in this specialized context remains unclear.

Methods

We evaluated three leading AI large language models (LLMs): ChatGPT, Gemini 2.5 Flash, and DeepSeek-V3. These were tasked to retrieve CPT codes from 30 microsurgical operative notes, retrieved from our prospective extremity reconstruction database. Using expert-assigned codes as the gold standard, we compared AI model performance via precision, recall, and Jaccard index.

Results

All AI models demonstrated poor agreement with human coders. ChatGPT performed best but achieved low precision (0.215), recall (0.230), and Jaccard index (0.148). Gemini and DeepSeek showed further reduced accuracy. Notably, models consistently overcoded, erroneously including add-on codes, which human coders deemed unnecessary by institutional standards.

Conclusion

Current LLMs are unreliable for independent CPT coding in microsurgical reconstruction, risking billing errors and compliance violations. While AI may aid as an adjunct tool, improvements in training data, payer–policy integration, and validation are needed before clinical implementation.

Zitieren

APA

Childs, J., Gomez, J. E. B., Llorens, M. R. O., & Haran, O. (2026). Artificial versus Human Intelligence: Evaluating CPT Coding Accuracy in Extremity Microsurgical Reconstruction. Journal of Reconstructive Microsurgery Open, 11(02), e31-e33. https://doi.org/10.1055/a-2920-4203

Vancouver

Childs J, Gomez JEB, Llorens MRO, Haran O. Artificial versus Human Intelligence: Evaluating CPT Coding Accuracy in Extremity Microsurgical Reconstruction. Journal of Reconstructive Microsurgery Open. 2026;11(02):e31-e33. doi:10.1055/a-2920-4203

BibTeX
@article{Childs2026,
  author = {Childs, Jonathan and Gomez, Juan E. Berner and Llorens, Manuel R. Ortiz and Haran, Oriana},
  title = {Artificial versus Human Intelligence: Evaluating CPT Coding Accuracy in Extremity Microsurgical Reconstruction},
  journal = {Journal of Reconstructive Microsurgery Open},
  year = {2026},
  volume = {11},
  number = {02},
  pages = {e31--e33},
  doi = {10.1055/a-2920-4203}
}
Kostenlos starten →