Being Aware of Data Leakage and Cross‐Validation Scaling in Chemometric Model Validation
Journal of Chemometrics · 2025-04 · 39 (4)
DOI: 10.1002/cem.70026 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Chemometrics, 2025-04. Verfasst von Péter Király und 1 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nemzeti Kutatási Fejlesztési és Innovációs Hivatal.
Abstract (Originalsprache)
The main goal of our investigation is to raise awareness among chemometricians about how easy it is to introduce data or parameter leakage by inappropriate methods and to demonstrate that high precision is necessary in the interpretation of opinions found in the literature on the preference of leave‐one‐out, leave‐many‐out, and repeated cross‐validation methods. We show how the Kennard–Stone method and inappropriate use of repeated measurements cause data leakage in train/test splitting. We demonstrate how cross‐validation parameters became overoptimistic if they are used in hyperparameter selection of models or in variable selection. We call this effect parameter leakage. We extend the leave‐one‐out/leave‐many‐out scaling law on repeated cross‐validation. We discuss and justify in some model calculations that infinite sample size inconsistencies of leave‐one‐out cross‐validation with respect to leave‐many‐out one can be theoretically important, but it need not be relevant at practical data sizes in chemometrics.
Förderung
- Nemzeti Kutatási Fejlesztési és Innovációs Hivatal
Zitieren
APA
Király, P., & Tóth, G. (2025). Being Aware of Data Leakage and Cross‐Validation Scaling in Chemometric Model Validation. Journal of Chemometrics, 39(4). https://doi.org/10.1002/cem.70026
Vancouver
Király P, Tóth G. Being Aware of Data Leakage and Cross‐Validation Scaling in Chemometric Model Validation. Journal of Chemometrics. 2025;39(4). doi:10.1002/cem.70026
BibTeX
@article{Kirly2025,
author = {Király, Péter and Tóth, Gergely},
title = {Being Aware of Data Leakage and Cross‐Validation Scaling in Chemometric Model Validation},
journal = {Journal of Chemometrics},
year = {2025},
volume = {39},
number = {4},
doi = {10.1002/cem.70026}
}
EUVIMED