EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Being Aware of Data Leakage and Cross‐Validation Scaling in Chemometric Model Validation

Péter Király, Gergely Tóth

Journal of Chemometrics · 2025-04 · 39 (4)

DOI: 10.1002/cem.70026 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Chemometrics, 2025-04. Verfasst von Péter Király und 1 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nemzeti Kutatási Fejlesztési és Innovációs Hivatal.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The main goal of our investigation is to raise awareness among chemometricians about how easy it is to introduce data or parameter leakage by inappropriate methods and to demonstrate that high precision is necessary in the interpretation of opinions found in the literature on the preference of leave‐one‐out, leave‐many‐out, and repeated cross‐validation methods. We show how the Kennard–Stone method and inappropriate use of repeated measurements cause data leakage in train/test splitting. We demonstrate how cross‐validation parameters became overoptimistic if they are used in hyperparameter selection of models or in variable selection. We call this effect parameter leakage. We extend the leave‐one‐out/leave‐many‐out scaling law on repeated cross‐validation. We discuss and justify in some model calculations that infinite sample size inconsistencies of leave‐one‐out cross‐validation with respect to leave‐many‐out one can be theoretically important, but it need not be relevant at practical data sizes in chemometrics.

Förderung

  • Nemzeti Kutatási Fejlesztési és Innovációs Hivatal

Zitieren

APA

Király, P., & Tóth, G. (2025). Being Aware of Data Leakage and Cross‐Validation Scaling in Chemometric Model Validation. Journal of Chemometrics, 39(4). https://doi.org/10.1002/cem.70026

Vancouver

Király P, Tóth G. Being Aware of Data Leakage and Cross‐Validation Scaling in Chemometric Model Validation. Journal of Chemometrics. 2025;39(4). doi:10.1002/cem.70026

BibTeX
@article{Kirly2025,
  author = {Király, Péter and Tóth, Gergely},
  title = {Being Aware of Data Leakage and Cross‐Validation Scaling in Chemometric Model Validation},
  journal = {Journal of Chemometrics},
  year = {2025},
  volume = {39},
  number = {4},
  doi = {10.1002/cem.70026}
}
Kostenlos starten →