skip to main content
10.1145/3487351.3489482acmconferencesArticle/Chapter ViewAbstractPublication PageskddConference Proceedingsconference-collections
research-article
Open access

The BiasChecker: how biased are social media searches?

Published: 19 January 2022 Publication History

Abstract

Social media searches are frequently employed by users to keep them up to date about ongoing events and learn broadly about public opinion on topics that are unfamiliar to them. Nevertheless, there are rising concerns about the results returned that can reinforce users' existing biases - the inclination to one opinion over another. This paper introduces a tool, called BiasChecker, that contributes to the check for bias in search results on a social media platform. BiasChecker follows a distributed and extendable architecture that allows us to simulate users following and unfollowing accounts, search for different polarised topics in a concurrent manner and measure bias. It may be applied to multiple social media platforms. The proposed tool takes into account several factors that can interfere with the detection of bias, e.g., the cross-over effect, geolocation, IP address, and language.

References

[1]
M. Z. van Drunen, N. Helberger, and M. Bastian, "Know your algorithm: what media organizations need to explain to their users about news personalization," International Data Privacy Law, 2019.
[2]
E. Bozdag, "Bias in algorithmic filtering and personalization," Ethics and information technology, vol. 15, no. 3, pp. 209--227, 2013.
[3]
E. Pariser, The Filter Bubble: What the Internet Is Hiding from You. Penguin Group, 2011.
[4]
R. K. Garrett, "Echo chambers online?: Politically motivated selective exposure among internet news users," Journal of computer-mediated communication, vol. 14, no. 2, pp. 265--285, 2009.
[5]
A. Hannak, P. Sapiezynski, A. Molavi Kakhki, B. Krishnamurthy, D. Lazer, A. Mislove, and C. Wilson, "Measuring Personalization of Web Search," in Proceedings of the 22nd International Conference on World Wide Web, ser. WWW '13. New York, NY, USA: Association for Computing Machinery, 2013, pp. 527--538.
[6]
P. Törnberg, "Echo chambers and viral misinformation: Modeling fake news as complex contagion," PloS one, vol. 13, no. 9, p. e0203958, 2018.
[7]
J. Tucker, A. Guess, P. Barbera, C. Vaccari, A. Siegel, S. Sanovich, D. Stukal, and B. Nyhan, "Social media, political polarization, and political disinformation: A review of the scientific literature," SSRN Electronic Journal, 01 2018.
[8]
T. R. Dillahunt, C. A. Brooks, and S. Gulati, "Detecting and visualizing filter bubbles in Google and Bing," in Conference on Human Factors in Computing Systems - Proceedings, vol. 18. Association for Computing Machinery, 2015, pp. 1851--1856.
[9]
S. Salehi, J. T. Du, and H. Ashman, "Examining Personalization in Academic Web Search," in Proceedings of the 26th ACM Conference on Hypertext & Social Media, ser. HT '15. New York, NY, USA: Association for Computing Machinery, 2015, pp. 103--111.
[10]
C. Kliman-Silver, A. Hannak, D. Lazer, C. Wilson, and A. Mislove, "Location, location, location: The impact of geolocation on web search personalization," in Proceedings of the 2015 internet measurement conference, 2015, pp. 121--127.
[11]
V. T. Hoang, A. Spognardi, F. Tiezzi, M. Petrocchi, and R. De Nicola, "Domain-specific queries and Web search personalization: Some investigations," in Electronic Proceedings in Theoretical Computer Science, EPTCS, L. A. L. ter Beek M.H., Ed., vol. 188. Open Publishing Association, 2015, pp. 51--58.
[12]
V. Cozza, V. T. Hoang, M. Petrocchi, and A. Spognardi, "Experimental measures of news personalization in Google News," Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9881 LNCS, pp. 93--104, 2016.
[13]
E. Pitoura, P. Tsaparas, G. Flouris, I. Fundulaki, P. Papadakos, S. Abiteboul, and G. Weikum, "On Measuring Bias in Online Information," SIGMOD Rec., vol. 46, no. 4, pp. 16--21, 2018.
[14]
R. E. Robertson, S. Jiang, K. Joseph, L. Friedland, D. Lazer, and C. Wilson, "Auditing Partisan Audience Bias within Google Search," Proc. ACM Hum.-Comput. Interact., vol. 2, no. CSCW, 2018.
[15]
H. Le, R. Maragh, B. Ekdale, A. High, T. Havens, and Z. Shafiq, "Measuring Political Personalization of Google News Search," in The World Wide Web Conference, ser. WWW '19. New York, NY, USA: Association for Computing Machinery, 2019, pp. 2957--2963.
[16]
J. C. dos Santos, S. W. M. Siqueira, B. Pereira Nunes, P. P. Balestrassi, and F. R. S. Pereira, "Is there personalization in twitter search? a study on polarized opinions about the brazilian welfare reform," in 12th ACM Conference on Web Science, ser. WebSci '20. New York, NY, USA: Association for Computing Machinery, 2020, p. 267--276.
[17]
E. Hargreaves, C. Agosti, D. Menasché, G. Neglia, A. Reiffers-Masson, and E. Altman, "Biases in the Facebook News Feed: A Case Study on the Italian Elections," in 2018 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM), 2018, pp. 806--812.
[18]
J. Kulshrestha, M. Eslami, J. Messias, M. B. Zafar, S. Ghosh, K. P. Gummadi, and K. Karahalios, "Quantifying search bias: Investigating sources of bias for political searches in social media," in Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing, ser. CSCW '17. New York, NY, USA: Association for Computing Machinery, 2017, p. 417--432.
[19]
J. Kulshrestha, M. Eslami, J. Messias, M. B. Zafar, S. Ghosh, K. P. Gummadi, and K. Karahalios, "Search bias quantification: investigating political bias in social media and web search," Information Retrieval Journal, vol. 22, no. 1, pp. 188--227, 2019.
[20]
F. McCown and M. L. Nelson, "Agreeing to disagree: Search engines and their public interfaces," in Proceedings of the 7th ACM/IEEE-CS Joint Conference on Digital Libraries, ser. JCDL '07. New York, NY, USA: Association for Computing Machinery, 2007, p. 309--318.

Cited By

View all

Index Terms

  1. The BiasChecker: how biased are social media searches?
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          ASONAM '21: Proceedings of the 2021 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining
          November 2021
          693 pages
          ISBN:9781450391283
          DOI:10.1145/3487351
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

          Sponsors

          In-Cooperation

          • IEEE CS

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 19 January 2022

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. filter bubble
          2. personalisation algorithms
          3. search mechanism
          4. social media

          Qualifiers

          • Research-article

          Conference

          ASONAM '21
          Sponsor:

          Acceptance Rates

          ASONAM '21 Paper Acceptance Rate 22 of 118 submissions, 19%;
          Overall Acceptance Rate 116 of 549 submissions, 21%

          Upcoming Conference

          KDD '25

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)123
          • Downloads (Last 6 weeks)17
          Reflects downloads up to 27 Jan 2025

          Other Metrics

          Citations

          Cited By

          View all

          View Options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Login options

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media