skip to main content
10.1145/3589334.3648152acmconferencesArticle/Chapter ViewAbstractPublication PagesthewebconfConference Proceedingsconference-collections
research-article
Open access

MMAdapt: A Knowledge-guided Multi-source Multi-class Domain Adaptive Framework for Early Health Misinformation Detection

Published: 13 May 2024 Publication History

Abstract

This paper studies a critical problem of emergent health misinformation detection, aiming to mitigate the spread of misinformation in emergent health domains to support well-informed healthcare decisions towards a Web for good health. Our work is motivated by the lack of timely resources (e.g., medical knowledge, annotated data) during the initial phases of an emergent health event or topic. In this paper, we develop a multi-source domain adaptive framework that jointly exploits medical knowledge and annotated data from different high-resource source domains (e.g., cancer, COVID-19) to detect misleading posts in an emergent target domain (e.g., mpox, polio). Two important challenges exist in developing our solution: 1) how to accurately detect the partially misleading and unverifiable content in an emergent target domain? 2) How to identify the conflicting knowledge facts from different source domains to accurately detect emergent misinformation in the target domain? To address these challenges, we develop MMAdapt, a multi-source multi-class domain adaptive misinformation detection framework that effectively explores diverse knowledge facts from different source domains to accurately detect not only the outright misleading but also the partially misleading or unverifiable posts on the Web. Extensive experimental results on four real-world misinformation datasets demonstrate that MMAdapt substantially outperforms state-of-the-art baselines in accurately detecting misinformation in an emergent health domain.

Supplemental Material

MP4 File
Video presentation
MP4 File
Supplemental video

References

[1]
Michael Arbel, Anna Korba, Adil Salim, and Arthur Gretton. 2019. Maximum mean discrepancy gradient flow. Advances in Neural Information Processing Systems, Vol. 32 (2019).
[2]
Meilin Cao, Jing Zhang, Sunyue Xu, and Zijian Ying. 2021. Knowledge graphs meet crowdsourcing: a brief survey. In International Conference on Cloud Computing. Springer, 3--17.
[3]
SRBH Chaturvedi and RC Shweta. 2015. Evaluation of inter-rater agreement and inter-rater reliability for observational data: an overview of concepts and methods. Journal of the Indian Academy of Applied Psychology, Vol. 41, 3 (2015), 20--27.
[4]
Canyu Chen and Kai Shu. 2023. Combating misinformation in the age of llms: Opportunities and challenges. arXiv preprint arXiv:2311.05656 (2023).
[5]
Canyu Chen, Haoran Wang, Matthew Shapiro, Yunyu Xiao, Fei Wang, and Kai Shu. 2022. Combating Health Misinformation in Social Media: Characterization, Detection, Intervention, and Open Issues. arXiv preprint arXiv:2211.05289 (2022).
[6]
Mingxi Cheng, Songli Wang, Xiaofeng Yan, Tianqi Yang, Wenshuo Wang, Zehao Huang, Xiongye Xiao, Shahin Nazarian, and Paul Bogdan. 2021. A COVID-19 rumor dataset. Frontiers in Psychology, Vol. 12 (2021).
[7]
Limeng Cui, Haeseung Seo, Maryam Tabar, Fenglong Ma, Suhang Wang, and Dongwon Lee. 2020. DETERRENT: Knowledge Guided Graph Attention Network for Detecting Healthcare Misinformation. In Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining.
[8]
Enyan Dai, Yiwei Sun, and Suhang Wang. 2020. Ginger cannot cure cancer: Battling fake health news with a comprehensive data repository. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 14. 853--862.
[9]
Aarzoo Dhiman and Durga Toshniwal. 2020. An unsupervised misinformation detection framework to analyze the users using covid-19 twitter data. In 2020 IEEE International Conference on Big Data (Big Data). IEEE, 679--688.
[10]
Andy Edinger, Danny Valdez, Eric Walsh-Buhi, Jennifer S Trueblood, Lorenzo Lorenzo-Luaces, Lauren A Rutter, and Johan Bollen. 2023. Misinformation and Public Health Messaging in the Early Stages of the Mpox Outbreak: Mapping the Twitter Narrative With Deep Learning. Journal of Medical Internet Research, Vol. 25 (2023), e43841.
[11]
Abolfazl Farahani, Sahar Voghoei, Khaled Rasheed, and Hamid R Arabnia. 2021. A brief review of domain adaptation. Advances in data science and information engineering: proceedings from ICDATA 2020 and IKE 2020 (2021), 877--894.
[12]
Masood Ghayoomi and Maryam Mousavian. 2022. Deep transfer learning for COVID-19 fake news detection in Persian. Expert Systems, Vol. 39, 8 (2022), e13008.
[13]
Deepanway Ghosal, Devamanyu Hazarika, Abhinaba Roy, Navonil Majumder, Rada Mihalcea, and Soujanya Poria. 2020. KinGDOM: Knowledge-Guided DOMain Adaptation for Sentiment Analysis. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics. 3198--3210.
[14]
César González-Fernández, Alberto Fernández-Isabel, Isaac Mart'in de Diego, Rubén R Fernández, and JFJ Viseu Pinheiro. 2021. Experts perception-based system to detect misinformation in health websites. Pattern Recognition Letters, Vol. 152 (2021), 333--339.
[15]
Bing He, Mustaque Ahamad, and Srijan Kumar. 2023. Reinforcement learning-based counter-misinformation response generation: a case study of COVID-19 vaccine misinformation. In Proceedings of the ACM Web Conference 2023. 2698--2709.
[16]
LinMei Hu, SiQi Wei, Ziwang Zhao, and Bin Wu. 2022. Deep learning for fake news detection: A comprehensive survey. AI Open (2022).
[17]
Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).
[18]
Yunyong Ko, Seongeun Ryu, Soeun Han, Youngseung Jeon, Jaehoon Kim, Sohyun Park, Kyungsik Han, Hanghang Tong, and Sang-Wook Kim. 2023. KHAN: Knowledge-Aware Hierarchical Attention Networks for Accurate Political Stance Prediction. In Proceedings of the ACM Web Conference 2023. 1572--1583.
[19]
Boshko Koloski, Timen Stepivs nik Perdih, Marko Robnik-vS ikonja, Senja Pollak, and Blavz vS krlj. 2022. Knowledge graph informed fake news classification via heterogeneous representation ensembles. Neurocomputing, Vol. 496 (2022), 208--226.
[20]
Ziyi Kou, Lanyu Shang, Yang Zhang, and Dong Wang. 2022. Hc-covid: A hierarchical crowdsource knowledge graph approach to explainable covid-19 misinformation detection. Proceedings of the ACM on Human-Computer Interaction, Vol. 6, GROUP (2022), 1--25.
[21]
Ziyi Kou, Lanyu Shang, Yang Zhang, Zhenrui Yue, Huimin Zeng, and Dong Wang. [n.,d.]. Crowd, expert & ai: A human-ai interactive approach towards natural language explanation based covid-19 misinformation detection.
[22]
Atsutoshi Kumagai and Tomoharu Iwata. 2019. Unsupervised domain adaptation by matching distributions based on the maximum mean discrepancy via unilateral transformations. In Proceedings of the AAAI Conference on Artificial Intelligence, Vol. 33. 4106--4113.
[23]
Bienvenido León, Mar'ia-Pilar Mart'inez-Costa, Ramón Salaverr'ia, and Ignacio López-Go ni. 2022. Health and science-related disinformation on COVID-19: A content analysis of hoaxes identified by fact-checkers in Spain. PloS one, Vol. 17, 4 (2022), e0265995.
[24]
Jinpeng Li, Yingce Xia, Xin Cheng, Dongyan Zhao, and Rui Yan. 2023. Learning disentangled representation via domain adaptation for dialogue summarization. In Proceedings of the ACM Web Conference 2023. 1693--1702.
[25]
Yichuan Li, Kyumin Lee, Nima Kordzadeh, Brenton Faber, Cameron Fiddes, Elaine Chen, and Kai Shu. 2021. Multi-Source Domain Adaptation with Weak Supervision for Early Fake News Detection. In 2021 IEEE International Conference on Big Data (Big Data). IEEE, 668--676.
[26]
Tim K Mackey, Vidya Purushothaman, Michael Haupt, Matthew C Nali, and Jiawei Li. 2021. Application of unsupervised machine learning to identify and characterise hydroxychloroquine misinformation on Twitter. The Lancet Digital Health, Vol. 3, 2 (2021), e72--e75.
[27]
Ahmadreza Mosallanezhad, Mansooreh Karami, Kai Shu, Michelle V Mancenido, and Huan Liu. 2022. Domain adaptive fake news detection via reinforcement learning. In Proceedings of the ACM Web Conference 2022. 3632--3640.
[28]
Yeimer Ortiz-Mart'inez, Jheinner Sarmiento, D Katterine Bonilla-Aldana, and Alfonso J Rodr'iguez-Morales. 2022. Monkeypox goes viral: Measuring the misinformation outbreak on Twitter. The Journal of Infection in Developing Countries, Vol. 16, 07 (2022), 1218--1220.
[29]
Kellin Pelrine, Meilina Reksoprodjo, Caleb Gupta, Joel Christoph, and Reihaneh Rabbany. 2023. Towards Reliable Misinformation Mitigation: Generalization, Uncertainty, and GPT-4. arXiv preprint arXiv:2305.14928 (2023).
[30]
Dale A Rose, Shivani Murthy, Jennifer Brooks, and Jeffrey Bryant. 2017. The evolution of public health emergency management as a field of practice. American journal of public health, Vol. 107, S2 (2017), S126--S133.
[31]
Grace B Russo, Tarini Goyal, Kenneth Tyler, and Kiran T Thakur. 2022. Re-emergence of poliovirus in the United States: Considerations and implications. Annals of neurology, Vol. 92, 5 (2022), 725--728.
[32]
Lanyu Shang, Ziyi Kou, Yang Zhang, Jin Chen, and Dong Wang. 2022a. A privacy-aware distributed knowledge graph approach to qois-driven covid-19 misinformation detection. In 2022 IEEE/ACM 30th International Symposium on Quality of Service (IWQoS). IEEE, 1--10.
[33]
Lanyu Shang, Yang Zhang, Zhenrui Yue, YeonJung Choi, Huimin Zeng, and Dong Wang. 2022b. A Knowledge-driven Domain Adaptive Approach to Early Misinformation Detection in an Emergent Health Domain on Social Media. In 2022 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM). IEEE, 34--41.
[34]
Jiaming Shen, Jialu Liu, Dan Finnie, Negar Rahmati, Mike Bendersky, and Marc Najork. 2023. "Why is this misleading?": Detecting News Headline Hallucinations with Explanations. In Proceedings of the ACM Web Conference 2023. 1662--1672.
[35]
Kirill Solovev and Nicolas Pröllochs. 2022. Moral emotions shape the virality of COVID-19 misinformation on social media. In Proceedings of the ACM web conference 2022. 3706--3717.
[36]
Qiurong Song and Jiepu Jiang. 2022. How Misinformation Density Affects Health Information Search. In Proceedings of the ACM Web Conference 2022. 2668--2677.
[37]
Abhijit Suprem and Calton Pu. 2022. MiDAS: Multi-integrated domain adaptive supervision for fake news detection. arXiv preprint arXiv:2205.09817 (2022).
[38]
Xing Tang, Ling Chen, Jun Cui, and Baogang Wei. 2019. Knowledge representation learning with entity descriptions, hierarchical types, and textual relations. Information Processing & Management, Vol. 56, 3 (2019), 809--822.
[39]
John P Thornhill, Sapha Barkati, Sharon Walmsley, Juergen Rockstroh, Andrea Antinori, Luke B Harrison, Romain Palich, Achyuta Nori, Iain Reeves, Maximillian S Habibi, et al. 2022. Monkeypox virus infection in humans across 16 countries-April-June 2022. New England Journal of Medicine, Vol. 387, 8 (2022), 679--691.
[40]
Amazon Mechanical Turk. [n.,d.]. https://www.mturk.com/
[41]
Amazon Mechanical Turk. 2016. Introducing Premium Qualifications. https://blog.mturk.com/introducing-premium-qualifications-1e473456e7b0
[42]
Frida Velcani, Irene C Kuo, Robert MQ Shanks, James Chodosh, Prashant Garg, Guillermo Amescua, and Michael E Zegans. 2023. Association of artificial tears with ocular and systemic infection: carbapenem-resistant Pseudomonas aeruginosa (VIM-GES-CRPA) outbreak. Ophthalmology (2023).
[43]
Zhenrui Yue, Huimin Zeng, Ziyi Kou, Lanyu Shang, and Dong Wang. 2022. Contrastive Domain Adaptation for Early Misinformation Detection: A Case Study on COVID-19. arXiv preprint arXiv:2208.09578 (2022).
[44]
Seongjun Yun, Minbyul Jeong, Raehyun Kim, Jaewoo Kang, and Hyunwoo J Kim. 2019. Graph transformer networks. Advances in neural information processing systems, Vol. 32 (2019).
[45]
Huimin Zeng, Zhenrui Yue, Ziyi Kou, Lanyu Shang, Yang Zhang, and Dong Wang. 2022. Unsupervised domain adaptation for covid-19 information service with contrastive adversarial domain mixup. In 2022 IEEE/ACM International Conference on Advances in Social Networks Analysis and Mining (ASONAM). IEEE, 159--162.
[46]
Yongchun Zhu, Qiang Sheng, Juan Cao, Qiong Nan, Kai Shu, Minghui Wu, Jindong Wang, and Fuzhen Zhuang. 2022. Memory-guided multi-view multi-domain fake news detection. IEEE Transactions on Knowledge and Data Engineering (2022).
[47]
Yuqi Zhu, Xiaohan Wang, Jing Chen, Shuofei Qiao, Yixin Ou, Yunzhi Yao, Shumin Deng, Huajun Chen, and Ningyu Zhang. 2023. LLMs for Knowledge Graph Construction and Reasoning: Recent Capabilities and Future Opportunities. arXiv preprint arXiv:2305.13168 (2023). n

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WWW '24: Proceedings of the ACM Web Conference 2024
May 2024
4826 pages
ISBN:9798400701719
DOI:10.1145/3589334
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 May 2024

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. domain adaptation
  2. healthcare misinformation
  3. knowledge graph
  4. multiclass classification

Qualifiers

  • Research-article

Funding Sources

Conference

WWW '24
Sponsor:
WWW '24: The ACM Web Conference 2024
May 13 - 17, 2024
Singapore, Singapore

Acceptance Rates

Overall Acceptance Rate 1,899 of 8,196 submissions, 23%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 279
    Total Downloads
  • Downloads (Last 12 months)279
  • Downloads (Last 6 weeks)87
Reflects downloads up to 06 Nov 2024

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media