skip to main content
10.1145/3638380.3638390acmotherconferencesArticle/Chapter ViewAbstractPublication PagesozchiConference Proceedingsconference-collections
short-paper

Intents and Motivations to Like, Comment and Share Posts With Warnings of Misinformation

Published: 10 May 2024 Publication History

Abstract

Social media platforms engage fact-checkers to label inaccurate posts and use detection algorithms to remove them. A desired secondary effect of the labels is to dampen post engagement. While studies have largely looked into how labels affect sharing intents, there is less work on other forms of post engagement and on labels provided by automated fact-checkers. As such, we investigate these aspects in a within-subjects experimental study with 36 participants set in the US political context. We find that warning labels generally reduce engagement with posts, even when different reasons for the warnings are given, suggesting their viability. Observing low correlations between the intents to like, comment and share posts and underlying differences in the reasons that motivate these engagements, we further encourage studies to consider more post engagement measures when evaluating the effectiveness of misinformation interventions.

References

[1]
Wazib Ansar and Saptarsi Goswami. 2021. Combating the menace: A survey on characterization and detection of fake news from a data science perspective. International Journal of Information Management Data Insights 1, 2 (2021), 100052. https://doi.org/10.1016/j.jjimei.2021.100052
[2]
Renee Barnes, Doug Mahar, Wendell Cockshaw, and Ides Wong. 2018. Personality and online news commenting behaviours: uncovering the characteristics of those below the line. Media International Australia 169, 1 (2018), 117–130. https://doi.org/10.1177/1329878X18798695 arXiv:https://doi.org/10.1177/1329878X18798695
[3]
Caleb T. Carr and Rebecca A. Hayes. 2015. Social Media: Defining, Developing, and Divining. Atlantic Journal of Communication 23, 1 (2015), 46–65. https://doi.org/10.1080/15456870.2015.972282 arXiv:https://doi.org/10.1080/15456870.2015.972282
[4]
Matteo Cinelli, Gianmarco De Francisci Morales, Alessandro Galeazzi, Walter Quattrociocchi, and Michele Starnini. 2021. The echo chamber effect on social media. Proceedings of the National Academy of Sciences 118, 9 (2021), e2023301118. https://doi.org/10.1073/pnas.2023301118 arXiv:https://www.pnas.org/doi/pdf/10.1073/pnas.2023301118
[5]
Katherine Clayton, Spencer Blair, Jonathan A. Busam, Samuel Forstner, John Glance, Guy Green, Anna Kawata, Akhila Kovvuri, Jonathan Martin, Evan Morgan, Morgan Sandhu, Rachel Sang, Rachel Scholz-Bright, Austin T. Welch, Andrew G. Wolff, Amanda Zhou, and Brendan Nyhan. 2020. Real Solutions for Fake News? Measuring the Effectiveness of General Warnings and Fact-Check Tags in Reducing Belief in False Stories on Social Media. Political Behavior 42, 4 (01 Dec 2020), 1073–1095. https://doi.org/10.1007/s11109-019-09533-0
[6]
Jay G Blumler & J R Brown Denis McQuail. 1972. The Television Audience: A Revised Perspective. Penguin Books, Harmondsworth.
[7]
Lisa A. Elkin, Matthew Kay, James J. Higgins, and Jacob O. Wobbrock. 2021. An Aligned Rank Transform Procedure for Multifactor Contrast Tests. In The 34th Annual ACM Symposium on User Interface Software and Technology (Virtual Event, USA) (UIST ’21). Association for Computing Machinery, New York, NY, USA, 754–768. https://doi.org/10.1145/3472749.3474784
[8]
Veikko Eranti and Markku Lonkila. 2015. The social significance of the Facebook Like button. First Monday 20, 6 (May 2015). https://doi.org/10.5210/fm.v20i6.5505
[9]
Mark E. Glickman, Sowmya R. Rao, and Mark R. Schultz. 2014. False discovery rate control is a recommended alternative to Bonferroni-type adjustments in health studies. Journal of Clinical Epidemiology 67, 8 (2014), 850–857. https://doi.org/10.1016/j.jclinepi.2014.03.012
[10]
Kathleen Hall Jamieson and Joseph N. Cappella. 2010. Echo Chamber: Rush Limbaugh and the Conservative Media Establishment. Oxford University Press.
[11]
Chenyan Jia, Alexander Boltz, Angie Zhang, Anqing Chen, and Min Kyung Lee. 2022. Understanding Effects of Algorithmic vs. Community Label on Perceived Accuracy of Hyper-Partisan Misinformation. Proc. ACM Hum.-Comput. Interact. 6, CSCW2, Article 371 (nov 2022), 27 pages. https://doi.org/10.1145/3555096
[12]
Daniel J. Hopkins John Sides. 2015. Political Polarization in American Politics. Bloomsbury Publishing.
[13]
Veronika Karnowski, Larissa Leonhard, and Anna Sophie Kümpel. 2018. Why Users Share the News: A Theory of Reasoned Action-Based Study on the Antecedents of News-Sharing Behavior. Communication Research Reports 35, 2 (2018), 91–100. https://doi.org/10.1080/08824096.2017.1379984 arXiv:https://doi.org/10.1080/08824096.2017.1379984
[14]
Elihu Katz, Jay G. Blumler, and Michael Gurevitch. 1973. Uses and Gratifications Research. The Public Opinion Quarterly 37, 4 (1973), 509–523. http://www.jstor.org/stable/2747854
[15]
Chei Sian Lee and Long Ma. 2012. News sharing in social media: The effect of gratifications and prior experience. Computers in Human Behavior 28, 2 (2012), 331–339. https://doi.org/10.1016/j.chb.2011.10.002
[16]
Chei Sian Lee, Long Ma, and Dion Hoe-Lian Goh. 2011. Why Do People Share News in Social Media?. In Active Media Technology, Ning Zhong, Vic Callaghan, Ali A. Ghorbani, and Bin Hu (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 129–140.
[17]
Jeffrey Lees, Abigail McCarter, and Dawn M. Sarno. 2022. Twitter’s Disputed Tags May Be Ineffective at Reducing Belief in Fake News and Only Reduce Intentions to Share Fake News Among Democrats and Independents. Journal of Online Trust and Safety 1, 3 (Aug. 2022). https://doi.org/10.54501/jots.v1i3.39
[18]
Jiawei Liu and Douglas M. McLeod. 2021. Pathways to news commenting and the removal of the comment system on news websites. Journalism 22, 4 (2021), 867–881. https://doi.org/10.1177/1464884919849954 arXiv:https://doi.org/10.1177/1464884919849954
[19]
Danielle Lottridge and Frank R. Bentley. 2018. Let’s Hate Together: How People Share News in Messaging, Social, and Public Networks. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3173574.3173634
[20]
Bertin Martens, Luis Aguiar, Estrella Gomez-Herrera, and Frank Mueller-Langer. 2018. The Digital Transformation of News Media and the Rise of Disinformation and Fake News. Technical Report. Digital Economy Working Paper 2018-02, Joint Research Centre Technical Reports. https://ssrn.com/abstract=3164170
[21]
Jens Mattke, Christian Maier, Lea Reis, and Tim Weitzel. 2020. Herd behavior in social media: The role of Facebook likes, strength of ties, and expertise. Information & Management 57, 8 (2020), 103370. https://doi.org/10.1016/j.im.2020.103370
[22]
Miller McPherson, Lynn Smith-Lovin, and James M Cook. 2001. Birds of a Feather: Homophily in Social Networks. Annual Review of Sociology 27, 1 (2001), 415–444. https://doi.org/10.1146/annurev.soc.27.1.415 arXiv:https://doi.org/10.1146/annurev.soc.27.1.415
[23]
Paul Mena. 2020. Cleaning Up Social Media: The Effect of Warning Labels on Likelihood of Sharing False News on Facebook. Policy & Internet 12, 2 (2020), 165–183. https://doi.org/10.1002/poi3.214 arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/poi3.214
[24]
Meta. 2020. Here’s how we’re using AI to help detect misinformation. Retrieved August 1, 2023 from https://ai.facebook.com/blog/heres-how-were-using-ai-to-help-detect-misinformation/
[25]
Meta. 2023. Meta’s Third-Party Fact-Checking Program. Retrieved August 1, 2023 from https://www.facebook.com/formedia/mjp/programs/third-party-fact-checking
[26]
Will Moy. 2021. Scaling Up the Truth: Fact-Checking Innovations and the Pandemic. National Endowment For Democracy. https://www.ned.org/wp-content/uploads/2021/01/Fact-Checking-Innovations-Pandemic-Moy.pdf.
[27]
Marie Ozanne, Ana Cueva Navas, Anna S. Mattila, and Hubert B. Van Hoof. 2017. An Investigation Into Facebook “Liking” Behavior An Exploratory Study. Social Media + Society 3, 2 (2017), 2056305117706785. https://doi.org/10.1177/2056305117706785 arXiv:https://doi.org/10.1177/2056305117706785
[28]
Gordon Pennycook, Adam Bear, Evan T. Collins, and David G. Rand. 2020. The Implied Truth Effect: Attaching Warnings to a Subset of Fake News Headlines Increases Perceived Accuracy of Headlines Without Warnings. Management Science 66, 11 (2020), 4944–4957. https://doi.org/10.1287/mnsc.2019.3478 arXiv:https://doi.org/10.1287/mnsc.2019.3478
[29]
Ike Picone, Ralf De Wolf, and Sarie Robijt. 2016. Who Shares What with Whom and Why?Digital Journalism 4, 7 (2016), 921–932. https://doi.org/10.1080/21670811.2016.1168708 arXiv:https://doi.org/10.1080/21670811.2016.1168708
[30]
Yoel Roth and Del Harvey. 2018. How Twitter is fighting spam and malicious automation. Retrieved August 1, 2023 from https://blog.twitter.com/en_us/topics/company/2018/how-twitter-is-fighting-spam-and-malicious-automation
[31]
Emily Saltz, Claire R Leibowicz, and Claire Wardle. 2021. Encounters with Visual Misinformation and Labels Across Platforms: An Interview and Diary Study to Inform Ecosystem Approaches to Misinformation Interventions. In Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (Yokohama, Japan) (CHI EA ’21). Association for Computing Machinery, New York, NY, USA, Article 340, 6 pages. https://doi.org/10.1145/3411763.3451807
[32]
Haeseung Seo, Aiping Xiong, and Dongwon Lee. 2019. Trust It or Not: Effects of Machine-Learning Warnings in Helping Individuals Mitigate Misinformation. In Proceedings of the 10th ACM Conference on Web Science (Boston, Massachusetts, USA) (WebSci ’19). Association for Computing Machinery, New York, NY, USA, 265–274. https://doi.org/10.1145/3292522.3326012
[33]
Gareth Smith. 2001. The 2001 General Election: Factors Influencing the Brand Image of Political Parties and their Leaders. Journal of Marketing Management 17, 9-10 (2001), 989–1006. https://doi.org/10.1362/026725701323366719 arXiv:https://doi.org/10.1362/026725701323366719
[34]
Matthew L. Stanley, Paul Henne, Brenda W. Yang, and Felipe De Brigard. 2020. Resistance to Position Change, Motivated Reasoning, and Polarization. Political Behavior 42, 3 (01 Sep 2020), 891–913. https://doi.org/10.1007/s11109-019-09526-z
[35]
Jomini Stroud, Emily Van Duyn, and Cynthia Peacock. 2016. Survey of Commenters and Comment Readers. Center for Media Engagement. Retrieved August 1, 2023 from https://mediaengagement.org/research/survey-of-commenters-and-comment-readers/
[36]
Ludovic Terren and Rosa Borge-Bravo. 2021. Echo Chambers on Social Media: A Systematic Review of the Literature. Review of Communication Research 9 (Mar. 2021), 99–118. https://rcommunicationr.org/index.php/rcr/article/view/94
[37]
Twitter. 2023. How we address misinformation on Twitter. Retrieved August 1, 2023 from https://help.twitter.com/en/resources/addressing-misleading-info
[38]
Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures. Association for Computing Machinery, New York, NY, USA, 143–146. https://doi.org/10.1145/1978942.1978963
[39]
L. Y.C. Wong and Jacquelyn Burkell. 2017. Motivations for Sharing News on Social Media. In Proceedings of the 8th International Conference on Social Media & Society (Toronto, ON, Canada) (#SMSociety17). Association for Computing Machinery, New York, NY, USA, Article 57, 5 pages. https://doi.org/10.1145/3097286.3097343
[40]
Xinyi Zhou and Reza Zafarani. 2020. A Survey of Fake News: Fundamental Theories, Detection Methods, and Opportunities. ACM Comput. Surv. 53, 5, Article 109 (sep 2020), 40 pages. https://doi.org/10.1145/3395046

Cited By

View all

Index Terms

  1. Intents and Motivations to Like, Comment and Share Posts With Warnings of Misinformation

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Other conferences
    OzCHI '23: Proceedings of the 35th Australian Computer-Human Interaction Conference
    December 2023
    733 pages
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 10 May 2024

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. automated fact-checking
    2. misinformation
    3. social media engagement
    4. warning labels

    Qualifiers

    • Short-paper
    • Research
    • Refereed limited

    Conference

    OzCHI 2023
    OzCHI 2023: OzCHI 2023
    December 2 - 6, 2023
    Wellington, New Zealand

    Acceptance Rates

    Overall Acceptance Rate 362 of 729 submissions, 50%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)24
    • Downloads (Last 6 weeks)3
    Reflects downloads up to 05 Feb 2025

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media