Relevance-aware Individual Item Fairness Measures for Recommender Systems: Limitations and Usage Guidelines
ACM Transactions on Recommender Systems · 30.09.2026 · 4 (3) · 1-45
DOI: 10.1145/3765624 ↗Kurz gefasst
Leitlinie in der Zeitschrift ACM Transactions on Recommender Systems, online erschienen am 05.03.2026. Verfasst von Theresia Veronika Rampisela und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 68 Literaturangaben. Gefördert von: Algorithms, Data, and Democracy project, Australian Research Council.
Abstract (Originalsprache)
Recommender Systems (RSs) aim at providing relevant items to users, with a recent emphasis on improving recommendation fairness. Quantifying fairness of the recommended items can be done with two types of evaluation measures: measures that are purely based on item exposure ( exposure-based ) and measures that account for both item exposure and item relevance ( relevance-aware ). While exposure-based measures have been thoroughly analysed, relevance-aware measures have not been examined in such detail yet. We gather all existing relevance-aware individual item fairness measures for RSs and study their theoretical properties. We find that all measures suffer from one or more limitations, which may cause issues in their computation, interpretability, or expressiveness. To address this, we correct the affected measures or explain why a limitation is unresolvable. Further, we empirically investigate the extent of the limitations on the measures and compare the original measures to our reformulations under common and extreme evaluation scenarios across real-world and synthetic data. Our experiments show that our reformulated measures successfully resolve the issues in the original measures. We conclude by providing practical guidelines on how to select measures for a range of use cases.
Förderung
- Algorithms, Data, and Democracy project
- Australian Research Council
Zitieren
APA
Rampisela, T. V., Maistro, M., Ruotsalo, T., Scholer, F., & Lioma, C. (2026). Relevance-aware Individual Item Fairness Measures for Recommender Systems: Limitations and Usage Guidelines. ACM Transactions on Recommender Systems, 4(3), 1-45. https://doi.org/10.1145/3765624
Vancouver
Rampisela TV, Maistro M, Ruotsalo T, Scholer F, Lioma C. Relevance-aware Individual Item Fairness Measures for Recommender Systems: Limitations and Usage Guidelines. ACM Transactions on Recommender Systems. 2026;4(3):1-45. doi:10.1145/3765624
BibTeX
@article{Rampisela2026,
author = {Rampisela, Theresia Veronika and Maistro, Maria and Ruotsalo, Tuukka and Scholer, Falk and Lioma, Christina},
title = {Relevance-aware Individual Item Fairness Measures for Recommender Systems: Limitations and Usage Guidelines},
journal = {ACM Transactions on Recommender Systems},
year = {2026},
volume = {4},
number = {3},
pages = {1--45},
doi = {10.1145/3765624}
}
EUVIMED