A Survey of Data Quality Requirements That Matter in ML Development Pipelines
Journal of Data and Information Quality · 30.06.2023 · 15 (2) · 1-39
DOI: 10.1145/3592616 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Data and Information Quality, online erschienen am 22.06.2023. Verfasst von Maria Priestley und 2 weiteren Autor:innen. Die Arbeit wurde bisher 84-mal zitiert (Crossref) und nennt 77 Literaturangaben. Gefördert von: European Union’s Horizon 2020 research and innovation programme under the projects EUHubs4Data, MediaFutures.
Abstract (Originalsprache)
The fitness of the systems in which Machine Learning (ML) is used depends greatly on good-quality data. Specifications on what makes a good-quality dataset have traditionally been defined by the needs of the data users—typically analysts and engineers. Our article critically examines the extent to which established data quality frameworks are applicable to contemporary use cases in ML. Using a review of recent literature at the intersection of ML, data management, and human-computer interaction, we find that the classical “fitness-for-use” view of data quality can benefit from a more stage-specific approach that is sensitive to where in the ML lifecycle the data are encountered. This helps practitioners to plan their data quality tasks in a manner that meets the needs of the stakeholders who will encounter the dataset, whether it be data subjects, software developers or organisations. We therefore propose a new treatment of traditional data quality criteria by structuring them according to two dimensions: (1) the stage of the ML lifecycle where the use case occurs vs. (2) the main categories of data quality that can be pursued (intrinsic, contextual, representational and accessibility). To illustrate how this works in practice, we contribute a temporal mapping of the various data quality requirements that are important at different stages of the ML data pipeline. We also share some implications for data practitioners and organisations that wish to enhance their data management routines in preparation for ML.
Förderung
- European Union’s Horizon 2020 research and innovation programme under the projects EUHubs4Data
- MediaFutures
Zitieren
APA
Priestley, M., O’donnell, F., & Simperl, E. (2023). A Survey of Data Quality Requirements That Matter in ML Development Pipelines. Journal of Data and Information Quality, 15(2), 1-39. https://doi.org/10.1145/3592616
Vancouver
Priestley M, O’donnell F, Simperl E. A Survey of Data Quality Requirements That Matter in ML Development Pipelines. Journal of Data and Information Quality. 2023;15(2):1-39. doi:10.1145/3592616
BibTeX
@article{Priestley2023,
author = {Priestley, Maria and O’donnell, Fionntán and Simperl, Elena},
title = {A Survey of Data Quality Requirements That Matter in ML Development Pipelines},
journal = {Journal of Data and Information Quality},
year = {2023},
volume = {15},
number = {2},
pages = {1--39},
doi = {10.1145/3592616}
}
EUVIMED