EUVIMEDEUVIMED entdecken
CrossrefInfokarte

Subgroup deployment-readiness audit of calibration and clinical utility in perioperative infection prediction

Hugo Guillen-Ramirez, Katharina Lucia Lucas, Yves Max Wintsch, Tobias Ueli Blatter, Karen Triep, Olga Endrich, Guido Beldi

Journal of the American Medical Informatics Association · 2026-10-30

DOI: 10.1093/jamia/ocag184 ↗
AbstractBibliografische Angaben

Abstract

Abstract Objective We audited deployment readiness of an end-of-surgery postoperative infection model across clinically relevant subgroups and assessed mitigation of subgroup miscalibration. Materials and Methods We analyzed out-of-fold predictions from 10 719 procedures (2014-2022) with 504 present-on-admission (POA)–coded postoperative infection events across recorded sex, age, and a clinical physiological-reserve proxy. We assessed discrimination, calibration, threshold-specific errors, and decision-curve net benefit, treating t = 0.10 as a reference anchor. We compared no recalibration with common and group-specific cross-fitted isotonic recalibration, evaluated a refit without the Synthetic Minority Oversampling Technique (SMOTE), and performed a temporal-holdout analysis. Results Overall area under the receiver operating characteristic curve (AUROC) was 0.876, with similar sex-marginal discrimination in women and men (0.878 vs 0.875). Calibration-in-the-large was −1.02 overall, −0.86 in frail, and −1.34 in prefrail patients; the 6-event nonfrail stratum was not estimable. At t = 0.10, net benefit was positive in frail and negative in prefrail patients in the source cohort, but negative prefrail utility did not persist in the ascertainable-period (2018-2022) and temporal analyses. Common recalibration moved overall calibration-in-the-large from −1.020 to −0.007. Removing SMOTE shifted overall calibration but did not reduce the reserve gradient. Temporal-holdout AUROC was 0.851 with persistent overprediction. Present-on-admission coding was effectively absent before 2018; prevalence-dependent results were therefore additionally reported for the ascertainable 2018-2022 period, and ascertainment differed by physiological reserve. Discussion Discrimination-only or sex-marginal evaluation would have missed deployment-relevant subgroup heterogeneity, while endpoint ascertainment affected prevalence-dependent interpretation. Conclusion Joint subgroup evaluation can identify deployment-relevant limitations missed by aggregate metrics. Prospective validation with comparable outcome ascertainment remains necessary before clinical deployment.

Wissen, das zu Ihrer Arbeit passt.

Vom kostenlosen Einstieg über die persönliche Recherche bis zur vollständigen Research Suite.

Tarife ansehen →

Sind alle Verlagsvolltexte enthalten?

Nein. Bibliografische Nachweise, Abstracts und Volltexte sind unterschiedliche Inhalte. Ob ein Volltext verfügbar ist, hängt von der Quelle, Open Access und Ihren vorhandenen Lizenzen ab. Ein EUVIMED-Tarif ersetzt keine zusätzlichen Verlagsrechte.

Tarife ansehen →