skip to main content
10.1145/3511047.3536400acmconferencesArticle/Chapter ViewAbstractPublication PagesumapConference Proceedingsconference-collections
extended-abstract

Multiperspective and Multidisciplinary Treatment of Fairness in Recommender Systems Research

Published: 04 July 2022 Publication History

Abstract

In the communities of UMAP, RecSys, and similar venues, fairness of recommender systems has primarily been addressed from the perspective of computer science and artificial intelligence, e.g.,  by devising computational bias and fairness metrics or elaborating debiasing algorithms. In contrast, we advocate taking a multiperspective and multidisciplinary viewpoint to complement this technical perspective. This involves considering the variety of stakeholders in the value chain of recommender systems as well as interweaving expertise from various disciplines, in particular, computer science, law, ethics, sociology, and psychology (e.g.,  studying discrepancies between computational metrics of bias and fairness and their actual human perception, and considering the legal and regulatory context recommender systems are embedded in).

References

[1]
Himan Abdollahpouri, Gediminas Adomavicius, Robin Burke, Ido Guy, Dietmar Jannach, Toshihiro Kamishima, Jan Krasnodebski, and Luiz Augusto Pizzato. 2020. Multistakeholder recommendation: Survey and research directions. User Model. User Adapt. Interact. 30, 1 (2020), 127–158. https://doi.org/10.1007/s11257-019-09256-1
[2]
Himan Abdollahpouri, Masoud Mansoury, Robin Burke, and Bamshad Mobasher. 2019. The Unfairness of Popularity Bias in Recommendation. In Proceedings of the Workshop on Recommendation in Multi-stakeholder Environments co-located with the 13th ACM Conference on Recommender Systems (RecSys 2019), Copenhagen, Denmark, September 20, 2019(CEUR Workshop Proceedings, Vol. 2440), Robin Burke, Himan Abdollahpouri, Edward C. Malthouse, K. P. Thai, and Yongfeng Zhang (Eds.). CEUR-WS.org. http://ceur-ws.org/Vol-2440/paper4.pdf
[3]
Himan Abdollahpouri, Masoud Mansoury, Robin Burke, and Bamshad Mobasher. 2019. The Unfairness of Popularity Bias in Recommendation. In Workshop on Recommendation in Multi-stakeholder Environments (RMSE’19), in conjunction with the 13th ACM Conference on Recommender Systems, RecSys’19.
[4]
Ashwathy Ashokan and Christian Haas. 2021. Fairness metrics and bias mitigation strategies for rating predictions. Information Processing & Management 58, 5 (2021), 102646. https://doi.org/10.1016/j.ipm.2021.102646
[5]
Robin Burke, Himan Abdollahpouri, Edward C. Malthouse, K. P. Thai, and Yongfeng Zhang. 2019. Recommendation in multistakeholder environments. In Proceedings of the 13th ACM Conference on Recommender Systems, RecSys 2019, Copenhagen, Denmark, September 16-20, 2019, Toine Bogers, Alan Said, Peter Brusilovsky, and Domonkos Tikk (Eds.). ACM, 566–567. https://doi.org/10.1145/3298689.3346973
[6]
L Elisa Celis, Damian Straszak, and Nisheeth K Vishnoi. 2018. Ranking with Fairness Constraints. In Proceedings of the 45th International Colloquium on Automata, Languages, and Programming (ICALP). Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.
[7]
Harshal A. Chaudhari, Sangdi Lin, and Ondrej Linda. 2020. A General Framework for Fairness in Multistakeholder Recommendations. CoRR abs/2009.02423(2020). arXiv:2009.02423https://arxiv.org/abs/2009.02423
[8]
Jiawei Chen, Hande Dong, Xiang Wang, Fuli Feng, Meng Wang, and Xiangnan He. 2022 (to appear). Bias and Debias in Recommender System: A Survey and Future Directions. Transactions on Knowledge and Data Engineering (2022 (to appear)).
[9]
European Commission. 2000. Directive 2000/43/EC implementing the principle of equal treatment between persons irrespective of racial or ethnic origin.
[10]
European Commission. 2000. Directive 2000/78/EC establishing a general framework for equal treatment in employment and occupation: Framework Directive.
[11]
European Commission. 2004. Directive 2004/113/EC implementing the principle of equal treatment between men and women in the access to and supply of goods and services: Goods and Services Directive.
[12]
European Commission. 2020. Proposal for a Regulation of the European Parliament and of the Council on a Single Market for Digital Services (Digital Services Act) and amending Directive 2000/31/EC: COM(2020) 825 final.
[13]
European Commission. 2020. Proposal for a Regulation of the European Parliament and of the Council on contestable and fair markets in the digital sector (Digital Markets Act): COM(2020) 842 final.
[14]
European Commission. 2021. Proposal for a Regulation of the European Parliament and of the Council laying down Harmonised Rules on Artificial Intelligence (Artificial Intelligence Act) and amending certain Union Legislative Acts: COM(2021) 206 final.
[15]
Maria De-Arteaga, Alexey Romanov, Hanna Wallach, Jennifer Chayes, Christian Borgs, Alexandra Chouldechova, Sahin Geyik, Krishnaram Kenthapadi, and Adam Tauman Kalai. 2019. Bias in bios: A case study of semantic representation bias in a high-stakes setting. In Proceedings of the Conference on Fairness, Accountability, and Transparency. 120–128.
[16]
Yashar Deldjoo, Vito Walter Anelli, Hamed Zamani, Alejandro Bellogín, and Tommaso Di Noia. 2021. A Flexible Framework for Evaluating User and Item Fairness in Recommender Systems. User Modeling and User-Adapted Interaction 31, 3 (2021), 457–511. https://doi.org/10.1007/s11257-020-09285-1
[17]
Tommaso Di Noia, Nava Tintarev, Panagiota Fatourou, and Markus Schedl. 2022. Recommender Systems under European AI Regulations. Commun. ACM 65, 4 (mar 2022), 69–73. https://doi.org/10.1145/3512728
[18]
Cynthia Dwork, Moritz Hardt, Toniann Pitassi, Omer Reingold, and Richard Zemel. 2012. Fairness through awareness. In Proceedings of the 3rd innovations in theoretical computer science conference. 214–226.
[19]
Michael D. Ekstrand, Anubrata Das, Robin Burke, and Fernando Diaz. 2022 (to appear). Fairness and Discrimination in Information Access Systems. Foundations and Trends in Information Retrieval (2022 (to appear)). arXiv:2105.05779https://arxiv.org/abs/2105.05779
[20]
Michael D. Ekstrand, Mucun Tian, Ion Madrazo Azpiazu, Jennifer D. Ekstrand, Oghenemaro Anuyah, David McNeill, and Maria Soledad Pera. 2018. All The Cool Kids, How Do They Fit In?: Popularity and Demographic Biases in Recommender Evaluation and Effectiveness. In Conference on Fairness, Accountability and Transparency, FAT 2018, 23-24 February 2018, New York, NY, USA(Proceedings of Machine Learning Research, Vol. 81), Sorelle A. Friedler and Christo Wilson (Eds.). PMLR, 172–186. http://proceedings.mlr.press/v81/ekstrand18b.html
[21]
Mehdi Elahi, Himan Abdollahpouri, Masoud Mansoury, and Helma Torkamaan. 2021. Beyond algorithmic fairness in recommender systems. In Adjunct Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization. 41–46.
[22]
Mehdi Elahi, Danial Khosh Kholgh, Mohammad Sina Kiarostami, Sorush Saghari, Shiva Parsa Rad, and Marko Tkalčič. 2021. Investigating the impact of recommender systems on user-based and item-based popularity bias. Information Processing & Management 58, 5 (2021), 102655.
[23]
Michael Feldman, Sorelle A Friedler, John Moeller, Carlos Scheidegger, and Suresh Venkatasubramanian. 2015. Certifying and removing disparate impact. In proceedings of the 21th ACM SIGKDD international conference on knowledge discovery and data mining. 259–268.
[24]
Alexander Felfernig, Gerhard Friedrich, Bartosz Gula, Martin Hitz, Thomas Kruggel, Gerhard Leitner, Rudolf Melcher, D. Riepan, S. Strauss, Erich Teppan, and Oliver Vitouch. 2007. Persuasive Recommendation: Serial Position Effects in Knowledge-Based Recommender Systems. In Persuasive Technology, Second International Conference on Persuasive Technology, PERSUASIVE 2007, Palo Alto, CA, USA, April 26-27, 2007, Revised Selected Papers(Lecture Notes in Computer Science, Vol. 4744), Yvonne de Kort, Wijnand A. IJsselsteijn, Cees J. H. Midden, Berry Eggen, and B. J. Fogg (Eds.). Springer, 283–294. https://doi.org/10.1007/978-3-540-77006-0_34
[25]
Christian Ganhör, David Penz, Navid Rekabsaz, Oleg Lesota, and Markus Schedl. 2022. Mitigating Consumer Biases in Recommendations with Adversarial Training. In Proceedings of the 45th International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2022. ACM.
[26]
Tanja Hentschel, Madeline E. Heilman, and Claudia V. Peus. 2019. The Multiple Dimensions of Gender Stereotypes: A Current Look at Men’s and Women’s Characterizations of Others and Themselves. Frontiers in Psychology 10 (2019). https://doi.org/10.3389/fpsyg.2019.00011
[27]
Ömer Kirnap, Fernando Diaz, Asia Biega, Michael D. Ekstrand, Ben Carterette, and Emine Yilmaz. 2021. Estimation of Fair Ranking Metrics with Incomplete Judgments. In WWW ’21: The Web Conference 2021, Virtual Event / Ljubljana, Slovenia, April 19-23, 2021, Jure Leskovec, Marko Grobelnik, Marc Najork, Jie Tang, and Leila Zia (Eds.). ACM / IW3C2, 1065–1075. https://doi.org/10.1145/3442381.3450080
[28]
Bart P. Knijnenburg, Martijn C. Willemsen, Zeno Gantner, Hakan Soncu, and Chris Newell. 2012. Explaining the User Experience of Recommender Systems. User Modeling and User-Adapted Interaction 22, 4-5 (2012), 441–504. https://doi.org/10.1007/s11257-011-9118-4
[29]
Dominik Kowald, Markus Schedl, and Elisabeth Lex. 2020. The Unfairness of Popularity Bias in Music Recommendation: A Reproducibility Study. In European Conference on Information Retrieval. Springer, 35–42.
[30]
Anja Lambrecht and Catherine Tucker. 2019. Algorithmic Bias? An Empirical Study of Apparent Gender-Based Discrimination in the Display of STEM Career Ads. Management Science 65, 7 (2019), 2966–2981. https://doi.org/10.1287/mnsc.2018.3093
[31]
Oleg Lesota, Alessandro B. Melchiorre, Navid Rekabsaz, Stefan Brandl, Dominik Kowald, Elisabeth Lex, and Markus Schedl. 2021. Analyzing Item Popularity Bias of Music Recommender Systems: Are Different Genders Equally Affected?. In Proceedings of the 15th ACM Conference on Recommender Systems (Late-Breaking Results). Amsterdam, the Netherlands.
[32]
Elisabeth Lex, Dominik Kowald, Paul Seitlinger, Thi Ngoc Trang Tran, Alexander Felfernig, and Markus Schedl. 2021. Psychology-informed Recommender Systems. Foundations and Trends® in Information Retrieval 15, 2(2021), 134–242.
[33]
Masoud Mansoury, Himan Abdollahpouri, Mykola Pechenizkiy, Bamshad Mobasher, and Robin Burke. 2020. FairMatch: A Graph-Based Approach for Improving Aggregate Diversity in Recommender Systems. Association for Computing Machinery, New York, NY, USA, 154–162. https://doi.org/10.1145/3340631.3394860
[34]
Masoud Mansoury, Bamshad Mobasher, Robin Burke, and Mykola Pechenizkiy. 2019. Bias Disparity in Collaborative Recommendation: Algorithmic Evaluation and Comparison. In Proceedings of the Workshop on Recommendation in Multi-stakeholder Environments co-located with the 13th ACM Conference on Recommender Systems (RecSys 2019), Copenhagen, Denmark, September 20, 2019(CEUR Workshop Proceedings, Vol. 2440), Robin Burke, Himan Abdollahpouri, Edward C. Malthouse, K. P. Thai, and Yongfeng Zhang (Eds.). CEUR-WS.org. http://ceur-ws.org/Vol-2440/paper6.pdf
[35]
Ninareh Mehrabi, Fred Morstatter, Nripsuta Saxena, Kristina Lerman, and Aram Galstyan. 2021. A Survey on Bias and Fairness in Machine Learning. Comput. Surveys 54, 6 (2021), 115:1–115:35. https://doi.org/10.1145/3457607
[36]
Alessandro B. Melchiorre, Navid Rekabsaz, Emilia Parada-Cabaleiro, Stefan Brandl, Oleg Lesota, and Markus Schedl. 2021. Investigating Gender Fairness of Recommendation Algorithms in the Music Domain. Information Processing & Management 58, 5 (2021), 102666. https://doi.org/10.1016/j.ipm.2021.102666
[37]
Alessandro B. Melchiorre and Markus Schedl. 2020. Personality Correlates of Music Audio Preferences for Modelling Music Listeners. In Proceedings of the 28th ACM Conference on User Modeling, Adaptation and Personalization, UMAP 2020, Genoa, Italy, July 12-18, 2020, Tsvi Kuflik, Ilaria Torre, Robin Burke, and Cristina Gena (Eds.). ACM, 313–317. https://doi.org/10.1145/3340631.3394874
[38]
Alessandro B. Melchiorre, Eva Zangerle, and Markus Schedl. 2020. Personality Bias of Music Recommendation Algorithms. In Fourteenth ACM Conference on Recommender Systems (Virtual Event, Brazil) (RecSys ’20). Association for Computing Machinery, New York, NY, USA, 533–538. https://doi.org/10.1145/3383313.3412223
[39]
Nicola Neophytou, Bhaskar Mitra, and Catherine Stinson. 2021. Revisiting Popularity and Demographic Biases in Recommender Evaluation and Effectiveness. CoRR abs/2110.08353(2021). arXiv:2110.08353https://arxiv.org/abs/2110.08353
[40]
European Parliament and the Council. 2006. Directive 2006/54/EC on the implementation of the principle of equal opportunities and equal treatment of men and women in matters of employment and occupation (recast): Gender Recast Directive.
[41]
Pearl Pu, Li Chen, and Rong Hu. 2011. A User-centric Evaluation Framework for Recommender Systems. In Proceedings of the 2011 ACM Conference on Recommender Systems, RecSys 2011, Chicago, IL, USA, October 23-27, 2011, Bamshad Mobasher, Robin D. Burke, Dietmar Jannach, and Gediminas Adomavicius (Eds.). ACM, 157–164. https://doi.org/10.1145/2043932.2043962
[42]
Navid Rekabsaz, Simone Kopeinik, and Markus Schedl. 2021. Societal Biases in Retrieved Contents: Measurement Framework and Adversarial Mitigation of BERT Rankers. In SIGIR ’21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event, Canada, July 11-15, 2021, Fernando Diaz, Chirag Shah, Torsten Suel, Pablo Castells, Rosie Jones, and Tetsuya Sakai (Eds.). ACM, 306–316. https://doi.org/10.1145/3404835.3462949
[43]
Francesco Ricci, Lior Rokach, and Bracha Shapira (Eds.). 2015. Recommender Systems Handbook(2nd ed.). Springer. https://doi.org/10.1007/978-1-4899-7637-6
[44]
Nasim Sonboli, Jessie J Smith, Florencia Cabral Berenfus, Robin Burke, and Casey Fiesler. 2021. Fairness and transparency in recommendation: The users’ perspective. In Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization. 274–279.
[45]
Till Speicher, Hoda Heidari, Nina Grgic-Hlaca, Krishna P Gummadi, Adish Singla, Adrian Weller, and Muhammad Bilal Zafar. 2018. A unified approach to quantifying algorithmic unfairness: Measuring individual &group unfairness via inequality indices. In Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining. 2239–2248.
[46]
Erich Christian Teppan and Alexander Felfernig. 2009. Impacts of decoy elements on result set evaluations in knowledge-based recommendation. Int. J. Adv. Intell. Paradigms 1, 3 (2009), 358–373. https://doi.org/10.1504/IJAIP.2009.026573
[47]
Dandan Wang and Yan Chen. 2020. A Novel Many-Objective Recommendation Algorithm for Multistakeholders. IEEE Access 8(2020), 196482–196499. https://doi.org/10.1109/ACCESS.2020.3034716
[48]
Dandan Wang and Yan Chen. 2021. A novel cascade hybrid many-objective recommendation algorithm incorporating multistakeholder concerns. Inf. Sci. 577(2021), 105–127. https://doi.org/10.1016/j.ins.2021.07.005
[49]
Siqi Wang, Jinjin Wang, Wenmin Guo, Hang Ye, Xinbo Lu, Jun Luo, and Haoli Zheng. 2019. Gender Difference in Gender Bias: Transcranial Direct Current Stimulation Reduces Male’s Gender Stereotypes. Frontiers in Human Neuroscience 13 (2019). https://doi.org/10.3389/fnhum.2019.00403
[50]
Alice Xiang and Inioluwa Deborah Raji. 2019. On the Legal Compatibility of Fairness Definitions. CoRR abs/1912.00761(2019). arXiv:1912.00761http://arxiv.org/abs/1912.00761
[51]
Sirui Yao and Bert Huang. 2017. Beyond parity: Fairness objectives for collaborative filtering. Advances in neural information processing systems 30 (2017).
[52]
Meike Zehlike, Francesco Bonchi, Carlos Castillo, Sara Hajian, Mohamed Megahed, and Ricardo Baeza-Yates. 2017. Fa*ir: A fair top-k ranking algorithm. In Proceedings of the 2017 ACM on Conference on Information and Knowledge Management. 1569–1578.
[53]
Rich Zemel, Yu Wu, Kevin Swersky, Toni Pitassi, and Cynthia Dwork. 2013. Learning fair representations. In International conference on machine learning. PMLR, 325–333.
[54]
Ziwei Zhu, Jianling Wang, and James Caverlee. 2020. Measuring and Mitigating Item Under-Recommendation Bias in Personalized Ranking Systems. In Proceedings of the 43rd International ACM SIGIR conference on research and development in Information Retrieval, SIGIR 2020, Virtual Event, China, July 25-30, 2020, Jimmy Huang, Yi Chang, Xueqi Cheng, Jaap Kamps, Vanessa Murdock, Ji-Rong Wen, and Yiqun Liu (Eds.). ACM, 449–458. https://doi.org/10.1145/3397271.3401177

Cited By

View all
  1. Multiperspective and Multidisciplinary Treatment of Fairness in Recommender Systems Research

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UMAP '22 Adjunct: Adjunct Proceedings of the 30th ACM Conference on User Modeling, Adaptation and Personalization
    July 2022
    409 pages
    ISBN:9781450392327
    DOI:10.1145/3511047
    Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 04 July 2022

    Check for updates

    Qualifiers

    • Extended-abstract
    • Research
    • Refereed limited

    Funding Sources

    • Austrian Science Fund (FWF)
    • State of Upper Austria and the Federal Ministry of Education, Science, and Research

    Conference

    UMAP '22
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 162 of 633 submissions, 26%

    Upcoming Conference

    UMAP '25

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)25
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 16 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media