EUVIMEDEUVIMED entdecken
CrossrefInfokarte

External validation and clinical implementation of clinical prediction models: a systematic review

Elijah J Suh, Joseph S Kang, James McDermott, Adam H Nelson, Yoona Kim, Justin Liu, Krish Shah, Brenda Yu, Brian Zhang, Su Bin Lim, Jeff Choi

Journal of the American Medical Informatics Association · 2026-10-30

DOI: 10.1093/jamia/ocag182 ↗
AbstractBibliografische Angaben

Abstract

Abstract Objectives To assess whether external validation and clinical implementation of clinical prediction models reflect sequential or distinct stages of a translational pathway. Materials and methods This cross-sectional meta-epidemiologic study analyzed 1072 machine learning-based clinical prediction models published across clinical domains (2017-2019). We assessed downstream external validation and clinical implementation via citation screening through August 2025. Evaluated exposures included public code availability, TRIPOD adherence, multicenter design, and sample size. Secondary outcomes included investigator overlap. Results Among 1072 studies, 88.1% lacked translational follow-up. Only 9.9% underwent external validation, and 5.2% reached clinical implementation. Code availability (odds ratio [OR] 3.04; 95% CI, 1.91-4.84) and higher TRIPOD adherence (OR 2.68 per 10% increase; 95% CI, 2.04-3.52) were significantly associated with external validation, but not consistently with clinical implementation. Notably, 39% of implemented models lacked prior external validation. Independent groups predominantly conducted external validation (72.6%), whereas implementation frequently involved original development teams. Discussion Findings indicate a divergence in algorithmic translation. Characteristics emphasizing evaluability (code availability, reporting transparency) facilitate external validation but do not ensure clinical implementation. The frequent bypass of independent validation before implementation highlights a reliance on institutional and operational factors rather than generalizable methodology. Conclusion External validation and clinical implementation appear to represent distinct translational processes rather than sequential stages influenced by a uniform set of factors. Current practices facilitate validation but inadequately address operational requirements for real-world deployment.

Wissen, das zu Ihrer Arbeit passt.

Vom kostenlosen Einstieg über die persönliche Recherche bis zur vollständigen Research Suite.

Tarife ansehen →

Sind alle Verlagsvolltexte enthalten?

Nein. Bibliografische Nachweise, Abstracts und Volltexte sind unterschiedliche Inhalte. Ob ein Volltext verfügbar ist, hängt von der Quelle, Open Access und Ihren vorhandenen Lizenzen ab. Ein EUVIMED-Tarif ersetzt keine zusätzlichen Verlagsrechte.

Tarife ansehen →