EUVIMEDEUVIMED entdecken
CrossrefInfokarte

Artificial versus Human Intelligence: Evaluating CPT Coding Accuracy in Extremity Microsurgical Reconstruction

Jonathan Childs, Juan E. Berner Gomez, Manuel R. Ortiz Llorens, Oriana Haran

Journal of Reconstructive Microsurgery Open · 2026-07-01 · 11 (02) · e31-e33

DOI: 10.1055/a-2920-4203 ↗
AbstractBibliografische Angaben

Abstract

Abstract Background Current Procedural Terminology (CPT) coding in microsurgical reconstruction requires precise translation of complex procedures into billable codes. Manual coding requires training and experience and it is a time-consuming task, in which mistakes are possible. Artificial intelligence (AI) tools may offer an efficient alternative, but their accuracy in this specialized context remains unclear. Methods We evaluated three leading AI large language models (LLMs): ChatGPT, Gemini 2.5 Flash, and DeepSeek-V3. These were tasked to retrieve CPT codes from 30 microsurgical operative notes, retrieved from our prospective extremity reconstruction database. Using expert-assigned codes as the gold standard, we compared AI model performance via precision, recall, and Jaccard index. Results All AI models demonstrated poor agreement with human coders. ChatGPT performed best but achieved low precision (0.215), recall (0.230), and Jaccard index (0.148). Gemini and DeepSeek showed further reduced accuracy. Notably, models consistently overcoded, erroneously including add-on codes, which human coders deemed unnecessary by institutional standards. Conclusion Current LLMs are unreliable for independent CPT coding in microsurgical reconstruction, risking billing errors and compliance violations. While AI may aid as an adjunct tool, improvements in training data, payer–policy integration, and validation are needed before clinical implementation.

Wissen, das zu Ihrer Arbeit passt.

Vom kostenlosen Einstieg über die persönliche Recherche bis zur vollständigen Research Suite.

Tarife ansehen →

Sind alle Verlagsvolltexte enthalten?

Nein. Bibliografische Nachweise, Abstracts und Volltexte sind unterschiedliche Inhalte. Ob ein Volltext verfügbar ist, hängt von der Quelle, Open Access und Ihren vorhandenen Lizenzen ab. Ein EUVIMED-Tarif ersetzt keine zusätzlichen Verlagsrechte.

Tarife ansehen →