EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Automated anomaly detection for categorical data by repurposing a form filling recommender system

Hichem Belgacem, Xiaochen Li, Domenico Bianculli, Lionel Briand

Journal of Data and Information Quality · 30.09.2024 · 16 (3) · 1-28

DOI: 10.1145/3696110 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Data and Information Quality, online erschienen am 04.10.2024. Verfasst von Hichem Belgacem und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Data quality is crucial in modern software systems, like data-driven decision support systems. However, data quality is affected by data anomalies, which represent instances that deviate from most of the data. These anomalies affect the reliability and trustworthiness of software systems, and may propagate and cause more issues. Although many anomaly detection approaches have been proposed, they mainly focus on numerical data. Moreover, the few approaches targeting anomaly detection for categorical data do not yield consistent results across datasets. In this article, we propose a novel anomaly detection approach for categorical data named LAFF-AD (LAFF-based Anomaly Detection), which takes advantage of the learning ability of a state-of-the-art form filling tool (LAFF) to perform value inference on suspicious data. LAFF-AD runs a variant of LAFF that predicts the possible values of a suspicious categorical field in the suspicious instance. LAFF-AD then compares the output of LAFF to the recorded values in the suspicious instance, and uses a heuristic-based strategy to detect categorical data anomalies. We evaluated LAFF-AD by assessing its effectiveness and efficiency on six datasets. Our experimental results show that LAFF-AD can accurately determine a high range of data anomalies, with recall values between 0.6 and 1 and a precision value of at least 0.808. Furthermore, LAFF-AD is efficient, taking at most 7000s and 735ms to perform training and prediction, respectively.

Zitieren

APA

Belgacem, H., Li, X., Bianculli, D., & Briand, L. (2024). Automated anomaly detection for categorical data by repurposing a form filling recommender system. Journal of Data and Information Quality, 16(3), 1-28. https://doi.org/10.1145/3696110

Vancouver

Belgacem H, Li X, Bianculli D, Briand L. Automated anomaly detection for categorical data by repurposing a form filling recommender system. Journal of Data and Information Quality. 2024;16(3):1-28. doi:10.1145/3696110

BibTeX
@article{Belgacem2024,
  author = {Belgacem, Hichem and Li, Xiaochen and Bianculli, Domenico and Briand, Lionel},
  title = {Automated anomaly detection for categorical data by repurposing a form filling recommender system},
  journal = {Journal of Data and Information Quality},
  year = {2024},
  volume = {16},
  number = {3},
  pages = {1--28},
  doi = {10.1145/3696110}
}
Kostenlos starten →